I am a mathematician; an algebraic topologist. And I am trying to answer the question:

What are the fundamental theorems of machine learning?

I don't know the answer to that question yet, but I'm closing in.