How to predict large unseen tabular datas with trained model?

[Pak (Pavel)]

I assume that there is a proper way to do that, probably involving something like .add_test, and making sure results wouldn’t be shuffled, but I ended up writing my own functions for that.

Some useful functions for tabular models

Added: The complete notebook with all these functions in use is now online Getting predictions for a model on a new dataset There could be a lot of reasons for getting predictions on a another (nor test, nor validation) set of data (dataframe). The obvious one is when you just want to predict on a new dataset, when you want preditions themselves. The second group of reasons lays in the field of data exploration. What if we would like to do some feature importance or partial dependence an…

You can get prediction with get_cust_preds() from there

The only major thing is that you should split the process of data object creation into 2 phases (as overwise it’s impossible to get normalisation parameters used )