BERT - Why is validation loss oscillating so much?

[bencoman]

one of the top results from validation loss oscillating - Google Search
looks applicable…

• optimization - Validation loss oscillates a lot, validation accuracy > learning accuracy, but test accuracy is high. Is my model overfitting? - Stack Overflow