Lesson 4

I am getting this error , no Idea on what it is .

Could Someone help with this ?

I came across this GitHub issue comment which provides an explanation for why this warning is displayed—my understanding is that deberta-v3-small is not pretrained to be a classifier so loading it for a classification task will initialize DebertaV2ForSequenceClassification weights (classifier.bias, classifier.weight, etc) randomly as there are no pretrained weights for them. And that deberta-v3-small will need to be fine-tuned for classification (which is done in the Lesson 4 notebook) for it to perform well on that task.

I don’t think this warning should prevent you from training the model. Were you able to continue with training?