How to change dropout in partially trained model

Part 1 (2018)
6

Sorry, if this has been posted elsewhere, but I couldn’t find it.
I seem to be having a pretty serious problem here (not being able to load/save properly), which might be caused by my failure to understand something really basic, which is really important.
So, what happens is, not only when I change dropout through ps, but even when not changing dropout “ocassionally” I get the above mentioned error (related to Error(s) in loading state_dict for Sequential).
Tried to reproduce, but it sometimes happens ans sometimes not.

So, what I did is:

  • Create a model as shown above
  • Trained a couple of epochs with with weights frozen, then unfrozen (using SGD with restarts)
  • Saved using learn.save() or best_save_name parameter in .fit()
  • Changed sz
  • Repeated the above steps.
  • Then all of a sudden happens and I don’t know how to get back to my previously trained state.

It appears to me, that many people would stumble across an issue like this. So, sorry again in case I double-posted, but I just couldn’t find that exact same problem.

I went through the relevant code bits in fastai library for loading and saving as well as instantiating new ConvLearners - just can’t get my head around what I should be doing differently.

Any ideas greatly appreciated.

1 Like