Self attention should be made for cnn_learner as well

After discovering self_attention for unet_learners, I’ve been using it for my own image segmentation tasks, and I found that it managed to speed up training significantly, also users have reported improved results on Jeremy’s image classification leaderboard scores. It would be great if we can enable self_attention for cnn_learners as well :slight_smile:

2 Likes