There’s an interesting moment in Lesson 14 saying that:
- Training Neural Network could take hours, while training Gradient Boosted Trees takes seconds, for the same task.
- And, that Gradient Boosted Trees have almost the same accuracy as Neural Network if used with proper Embeddings.
The video https://youtu.be/1-NYPQw5THU?t=12m50s
But there’s one thing I don’t understand - how to get Embeddings without Neural Network?
My understanding is that you use Neural Network with Embedding Layer first. And then you get those trained embeddings and reuse it with Gradient Boosted Trees.
But it kinda defeats the whole point of using Gradient Boosted Trees as a more performant and lightweight technic - because you can’t speed up the training to seconds. You still have to build Nerual Net and spent hours training Embeddings on Neural Net first.
Seems like I missing some important point…
P.S. Lesson 14 is awesome! Learned tons of useful tricks and approaches. Huge thanks!