The validation loss is calculated as the average loss over all the mini batches. Code for reference is :https://github.com/fastai/fastai/blob/master/fastai/basic_train.py#L49
My questions are:
- Do we follow the same for train loss i.e. average all the losses over minibatches? This is required for reporting after every epoch
- Why don’t we calculate the loss on the entire validation data(predict on the whole validation data and get the loss) at the end of every epoch?