Also while I’m talking about Tesla, they had an “Autonomy Day” a few days ago which was basically talking about how they design every aspect of their AutoPilot hardware and software. Very interesting also.
Thanks. It’s a great read, written in accessible language. Karpathy stresses the importance of visualising what is happening during training, which reminded me of Lesson 10.
… suffering is a perfectly natural part of getting a neural network to work well, but it can be mitigated by being thorough, defensive, paranoid, and obsessed with visualizations of basically every possible thing.
I enjoyed the “Neural Network Essentials” part from Karpathy’s Tesla “Autonomy Day” presentation.