Is there a difference between a “Cost” function and a “Loss” function?
I am building out my own excel spreadsheet, trying to make sure I really get the concepts, and I am struggling a bit with terminology.
For example, I have seen Mean Squared Error referred to as a “Cost Function”.
But I as I have been studying the notebooks (lesson 2 and the SGD-intro), I see the Sum of Squared Errors being used as a “loss” function.
Maybe I am not even sure if MSE and SSE are the same (i was thinking they were one in the same? maybe a bad assumption)…
And advice would be highly welcomed. Thanks.