I have worked on implementing FixMatch for semi-supervised learning as a callback.
A complete example can be found here
Next step is to see how it performs on Imagewang. Hope it can make it to the leaderboard 
Currently, rand_augment_transform from timm is being used.
Any suggestions on how to integrate batch augmentations on the gpu?
Thanks,