I have 3 models I trained and I want to ensemble them together in hope of getting better results.
What is the best way of doing that:
- Taking the softmaxes of each model and do averege
- Taking the softmaxes and concatenating them and feeding it into Xgboost
- Taking the last Linear output (not softmaxes) and feeding it into Xgboost
- Other ways I don’t know about
Thanks in advance!