ULMFit for Genomics or Proteins or Sequence Tagging Task

(Md Mofijul Islam) #1

Does anyone try ULMFit for genomics or proteins or any other sequence tagging(not natural text) task?


(Michael) #2

I tried to play with it but had to give up because of the lack of GPU power.

I tried to use the hg38/GRCh38 human reference genome for my experimental setup with a simple base tokenization method and I also trained a sentencepiece model for tokenization.

This is something I am very interested in and maybe I will give it another try when I have more GPU power available. :slight_smile: