Regularization for a seq2seq attn model applied for Time Series using fastaiv1


I am currently trying to train a seq2seq attn model for time series ( stock prices) forecasting. I am using a customized version of this model from fastai part 2.

also created a custom ItemList and DataBunch for Time series.
using the RNNLearner from fastai.text to create the learner and train.

The problem the model looks like it is heavily overfitting.

I have used self.out_drop = nn.Dropout(0.8) from the notebook from part 2. to get this results in the screenshot.

How can i regularize the model more to reduce the overfitting?