Link for another tool to visualize transformers: https://github.com/jessevig/bertviz
Should be relatively easy to integrate with https://forums.fast.ai/t/gpt-2-text-generation-fine-tuning-with-fastai2/69835
4 Likes
Here is the corresponding paper: https://debug-ml-iclr2019.github.io/cameraready/DebugML-19_paper_2.pdf