Different training and validation loss for same data

Part 1 (2018) Beginner (2018)
1

Just to give it a start i used the same set of images (mnist jpgs) as training and validation sets for ImageClassifierData.from_paths

>data = ImageClassifierData.from_paths(PATH, tfms=tfms_from_model(arch, sz),
>                                       trn_name='trainingSet', val_name='trainingSet',
>                                       test_name='testSet')

What i noticed is that validation loss was consistently lower than training loss, but actually these sets were identical. I find this interesting. I would think that because it’s actually the same images used as training and validation sets, that the loss for both should be the same or similar. See below. Does it make sense?

image
image.png726Ă—656 18.8 KB

1 Like
2

This is interesting. Generally “dropout” is used during training and not in validation/testing. This could be a possible reason. I am curious to know what other possible reasons could be there.

Update: This is where Jeremy explains it.

3

@akschougule
That is great. Thanks for the link to the video!