Fastai v2 text

[MicPie (Michael)]

Could this architecture be something for fastai v2?

Good readings 2019

This is an interesting publication by S. Merity about a single headed attention LSTM with promising results for such a small model: „Single Headed Attention RNN: Stop Thinking With Your Head“

If, I’m happy to contribute!