L-05: How is the moving average of momentum and RMSProp is calculated initially

[Jasmine]

Hope this thread would help.

Lesson 4 Where are the first value of momentum multiply come from(graddesc.xlsm, momentum page)

Just to be accurate, Lesson 4, 32:44 has -18.33 and 98.25 in J3 and K3 respectively. The values -19.28 and 162.84 are generated only after the first Run (or 5 epochs). Now here is how I see it: The values in J3 and K3 are copied from J33 and K33 respectively. And the values in J33 and K33 are copied from J32 and K32. The confusing bit perhaps is that you don’t see J32 and J33 or K32 and K33 containing the same values. This is because the moment the Run macro copies values from J32 to J33 and…