L-05: How is the moving average of momentum and RMSProp is calculated initially

[orky]

Hello, I have a query related to Part-1 Lecture-5. During 1:48 mark and 1:53 mark in the video an excel sheet is shown (https://docs.google.com/spreadsheets/d/1uUwjwDgTvsxW7L1uPzpulGlUTaLOm8b-R_v0HIUmAvY/edit#gid=1973418598) if you click on the momentum sheet or rmsprop sheet they have this moving average in cell J3 and K3 which refers to cell J33 and K33 respectively. My question is from where is the initial value calculated are they random or what?

Thanking you.

[Jasmine]

Hope this thread would help.

Lesson 4 Where are the first value of momentum multiply come from(graddesc.xlsm, momentum page)

Just to be accurate, Lesson 4, 32:44 has -18.33 and 98.25 in J3 and K3 respectively. The values -19.28 and 162.84 are generated only after the first Run (or 5 epochs). Now here is how I see it: The values in J3 and K3 are copied from J33 and K33 respectively. And the values in J33 and K33 are copied from J32 and K32. The confusing bit perhaps is that you don’t see J32 and J33 or K32 and K33 containing the same values. This is because the moment the Run macro copies values from J32 to J33 and…