Sorry for the rather obvious question but I couldn’t find an answer in forum.
Context is that I’m trying to train word vectors for Thai language using Wikipedia data dump and the fastai language model introduced in Lesson 4. (Yes, there are several library that extracted the word vectors like fasttext but I wanted to benchmark them and I hope our methods involving SGDR and such could provide better performance).
Now if I understand it correctly, the language model of fastai library will transforms the words into vectors then use them to predict the next word given context. But how do we extract these vectors?
Thanks in advance!