Generic Multitask implementation with Fastai 1.0

[Richard-Wang]

Hi all, I created a MultiTaskLearner that don’t need to concat any thing.

You migh be interested in it.

Pretrain & Finetune MLM with fastai 5: Multi-task Learning using fastai

I created MultiTaskLearner that Don’t need to creat a single dls for all tasks’ dataloading Don’t need to hack model to output concatenated outputs for all tasks Of course is general but not limited to training GLUE tasks. Prints results beautifully. [image] Finetune_GLUE_with_fastai.ipynb: shows hot to use MultiTaskLearner mutlit_task.py: define MultiTaskLearner and other classes Notes for Mechanism: cycle [image] If you don’t just…