Create your own image transfer learning data?

[charliec (charlie)]

Hi everyone!

I have a crop image dataset that I am trying to predict with a new dataset of images.

There is a huge public dataset already out there that I could use. I’m trying to figure out if I could create my own sort of resnet type transfer learning to bring into my resnet model to increase my accuracy. Perhaps I’m missing something super obvious on how to do this in the best possible way.

Ideas?
Best,
Charlie

[johannesstutz (Hannes)]

Hi!

I’m not sure what to make of this:

I have a crop image dataset that I am trying to predict with a new dataset of images.

Maybe I’m missing something here, but have you tried training on the public dataset first (usually using an already Imagenet-pretrained model), and then further finetune your model with your custom dataset?

[charliec (charlie)]

Hi.
I have, but what I’m trying to sort through is I have saved and exported my model.
I found this thread and wanted to do something similar:

Transfer learning... twice?

Yes, the production images are of varying size and resolution. Some of these images are thumbnail sized and some are much larger and higher resolution. They are resized to 299, however, just like the training environment. Maybe train a small image and large image model? I Will caveat that the problem I’m attempting to tackle is complex, so I guess I’m more or less wondering, do I continue to re-train the model with the data it mis-labeled vs transfer learn my previous model vs use a multi-…

I’ve trained my model on my images (call it imageSet1) and trained on the new image set (imageSet2) using a similar basic setup.

What I think I’m missing is how can I take my trained imageSet1 and how do I transfer learn that and build it out with resnet etc. to get transfer learning from both. Again, maybe I’m missing something obvious.

I have saved and exported both, I’m just missing the connection.

[johannesstutz (Hannes)]

Hi, I’m not sure what the best way to deal with this is.

If you don’t want to train again, try using both models, and averaging their predictions. Just like ensembling of any other models would work.

I don’t know if there is a way to combine them in a single model (what you might be asking for?).

If you can afford to train again, I’d say try combining both datasets and train a new model on it. Or, take the model that was trained on the large dataset and finetune it with your smaller dataset for a few epochs, that should be faster?

[danjjohns (dan)]

So I have found the easiest approach is to retrain the entire model once xx number of false positives have been identified. Simply retraining on a few small examples just didn’t seem to have that large of an impact. It also became a less general model. It’s likely I’ve missed a simple step, but that approach has worked in our production scenario.