Does learning rate change across epochs?

I’m noticing that I sometimes see my valid_loss and accuracy improve for the first few epochs and then get worse and worse in the following epochs, and then start improving again for the last epoch or two. I’m trying to work out why this is. Is there something that automatically varies across the epochs? Like maybe learning rate?