Timm learner and nasnet?

Deep Learning
6

Hi charliec, you can do this for ViT:

model = timm.create_model('vit_large_patch16_224', pretrained=True)
for param in model.parameters():
  param.requires_grad=True

n_classes=len(dls.train_ds.vocab)
outputs_attrs = n_classes
num_inputs = model.head.in_features
last_layer = nn.Linear(num_inputs, outputs_attrs)
model.head = last_layer

learner17May_50cl_vit_large_patch16_224=Learner(dls,model,metrics=[accuracy,
                                                        top_3_accuracy,
                                                        f1score,
                                                        prec,
                                                        rocauc],
                                    opt_func=ranger,model_dir=classes_50_models_path2)

Hope this helps.

2 Likes