Using image's metadata in a timm model

fastai
1

Hi to the community.

I am currently using the pre-trained effecientnetb0 from timm for a classification task. What I want to do is to incorporate image along with its corresponding metadata.

Unfortunately, I am not able to find the resources/documentation showing an example of this in fastai.

So any help would be appreciated. Thanks

2

Just some high level suggestions.

  1. You may need to convert the pre-trained model so that fastai can recognize it. (not sure on this one)
  2. create a datasets and dataloders from labelled data ← fastai has good tools for this
  3. fine tune the pretrained model on the data created in step2, and test on test test set to see acc1 and acc5.

Good luck.