Fastai integration with huggingface pytorch-transformers?

[abhikjha (Abhik)]

Hey, I just posted reference of my medium article on “Share your work here” section.

Here is the link:

Share your work here

Hello everyone I recently wrote a medium article on the integration of Fastai with BERT (huggingface’s pretrained pytorch models for NLP) on a multi-label text classification task. After that I compared the performances of BERT and ULMFiT. Here are few things which I did to integrate Fastai with BERT: Using BERT’s tokens and vocab Some modifications in BERT’s tokens for eos and bos parts Splitting the model for discriminative learning techniques Here is the link: I was amazed by the le…