Hi @mushroom, the main guidance you’re looking for can be found in lesson 4 of this year’s course, available here. That’s a link to the in-class discussion when the course was live, and here’s a link to the video. It’ll show you how to build a classifier in the exact way you’ve described. In fact, you won’t even need to pretrain a model on Wikipedia first, it’s already been built, you’ll just fine-tune the published one for your task. Later, when you’ve tried the method yourself on your own dataset, you can look in the community forum on how to extend the model to a question-answering system.
1 Like