I made a multi class image classification model which does the identification of images into three catgegories. It worked great.
Now I have more similar data, but has 4 labels. I was wondering if I could use the above model( its weights) to retrain it for 4 labels. Does it sound good? If yes, how would I do that. I can certainly load the model like, but after that I am clueless.
Though, I dont see any improvement. In fact I see either same level of performace or slightly worse. Is it due to less number of training data? The images are very similar though.