you will also need a model that can accommodate all this data together. You may start from here:
https://docs.fast.ai/tutorial.itemlist.html
and here: https://gist.github.com/EtienneT/c07994bc96e9fad7a30a89cb9f20bc6b
If you like, we could work together, I have the same problem.
I don’t know how to build such a model…
It should take a pair (image, data) and feed this to output a numerical value.
Feed the image trough a convnet (resent18 for instance) and the data through a TabularModel, and then join everything after the flatten layers. Stack some denselayers and output your desired output.
1 Like