I wrote a summary of the GPT-3 paper, you can find it here - link or medium.
Does anyone else had a chance to read the paper? I personally find it disappointing as it is lengthy but does not describe very well the model or the training. It keeps the reader with a lot of unanswered questions, like how they parallelized the model.
3 Likes