Need help with implementing gpt-2 from scratch

[arora_aman (Aman Arora)]

Here is another excellent post explaining how the model works.

The Illustrated GPT-2 (Visualizing Transformer Language Models)