If I were choosing in your particular case, I’d probably go with something like 5e-2, which is high but farther away from where loss starts to increase. You don’t want to go too low or it will take forever to train the model.
I’d also suggest taking a look at the Automated Learning Rate Suggester post