Do you know any fastai for LLMs?

Deep Learning
1

I want to learn about LLMs in the fastai style

2

Hmm, Hugging Face offers a transformers course which teaches transformers in the context of their libraries.

I’ve done the first few chapters from it, and I think it does have that top-down fastai style to it. Right from chapter 1, you implement your first transformers, and the proceeding chapters break it down further and further.

1 Like