When to stop training a model?

[LessW2020 (Less)]

@mgloria

How can I modify dropout?

Here you go - I thought it might be better served as a standalone thread since others may have the same question:

How to adjust dropout in your models

In response to a question, here’s how you can dynamically adjust the dropout level of your model while training. (Below is ResNet50 model). [adjusting-dropout-res50] Basically, you have to locate where the dropout layer is, and then reference it directly and adjust the .p (probability) variable to your desired value. Note that the new XResNet doesn’t even use dropout, and recent work has shown that you are better off to use data augmentation instead of dropout…but the above is the quick way …