An overview of gradient descent optimization algorithms

Excellent, glad it’s on the radar. I had the presence of mind to search the forum for mention of it, but didn’t think to search the wiki. Oh well, best laid plans… :slight_smile: Cheers.