Just a general question, would you guys (devs) or others in general be interested in a PR that includes a utility function for transferring weights from similar architectures? IE transfering a model’s weights trained on ImageWoof to a model being used on the PETs dataset?
See this post for a general idea: Loading pretrained weights that are not from ImageNet