Can use swa in fastai?

Part 1 (2019)
1

Hello! I’m learning how to use fastai in recent days.

I want to use swa in fastai for ensemble.
In last year, there was an implementation for this, but I couldn’t find it now in latest version.

If I need to implement it, which part of callback function should I use?

Thanks!

1 Like
2

See writeup by William Horton here:

Though I can’t see implementation of SWA in v1 or v2, may need to take the post as a guide to implement it

3 Likes
3

Hi, I am looking for SWA in fastai ,could anyone provide implementation resource for SWA in latest FastAI. I could not find anything on internet, also Pytorch contrib has swa implementation, can we use by making custom optimizer in FastAI