Does anyone know if it would be possible to use something like Bert for topic modeling? The main deep learning method that I have seen for topic modeling is lda2vec, but the pytorch port did not seem to have great things to say about the way that is was set up in the paper. Is there some other way to topic modeling using Deep Learning, preferably using fast.ai?
Yes. In this code there is an approach to do topic modelling via Bert.