I have completed the ML course till Lesson 3. And been trying couple of competitions on Kaggle to learn and understand the code better. One of the competitions has been the TFI Restaurant Prediction:
As I am up to Lesson 3, I have extracted features from date, and changed text data to categories. Now the train data set is very small. So I am using OOB score and RMSE on train data as a starting point.
The problem I was facing that both OOB score and RMSE scores fluctuated widely across runs. For example,
1st run: -0.04 (OOB)
2nd Run: -0.15
3rd Run: -0.01
What can I do in such scenarios?