Training and validation data loader

Part 2 & Alumni (2018)
1

Trying to understand different behaviors of validation and training loader in pascal and pascal-multi notebook.

Every time, I execute

x,y=next(iter(md.trn_dl)) ; show_img(md.trn_ds.denorm(to_np(x))[0]);

I could see different “x” and “y” . If I am not wrong then that how iterator should give us next “x” and “y”. But this is not true for “md.val_dl”.

It does not matter how many times i executed

x,y=next(iter(md.val_dl)) ; show_img(md.val_ds.denorm(to_np(x))[0]);

value of “x” and “y” does not change. It does not iterate through all validation dataset.

Can someone explain me this behavior?

2

Every time you call iter(), a new iterator is created. In order to iterate over whole dataset using next() you have to store the iterator somewhere.

it = iter(md.trn_dl)
x,y=next(it) ; show_img(md.trn_ds.denorm(to_np(x))[0]);
x,y=next(it) ; show_img(md.trn_ds.denorm(to_np(x))[0]);
...

The difference between training and validation data loader is that the former shuffle the data.

1 Like
3

Thank you Marcin!!