I believe it would be interesting to develop a little more the thoughts on the Curse of Dimensionality you highlighted in Lesson 10 (48th minute - when justifying usage of
cosine rather than
euclidean for k-NN purposes)
I was a little confused :
Let's say that the probability it sits right on the edge is 1/10, then if you go 1 dimension, you've got a probability of 1/10 that it's on the edge in 1 dimension. In 3 dimensions, it's basically multiplicatively decreasing the probability that that happens. So in a few hundred dimensional space, everything is on the edge.
You probably meant "In 3 dimensions, it's basically multiplicatively increasing" ?
Found that good resource here which even takes Cats vs Dogs as an example, yay