I am getting this error , no Idea on what it is .
Could Someone help with this ?
I came across this GitHub issue comment which provides an explanation for why this warning is displayed—my understanding is that deberta-v3-small
is not pretrained to be a classifier so loading it for a classification task will initialize DebertaV2ForSequenceClassification
weights (classifier.bias
, classifier.weight
, etc) randomly as there are no pretrained weights for them. And that deberta-v3-small
will need to be fine-tuned for classification (which is done in the Lesson 4 notebook) for it to perform well on that task.
I don’t think this warning should prevent you from training the model. Were you able to continue with training?