there is no x_val and y_val. @jeremy told on one of video that our model during training should never see the test data. But then the fit_generator code above is seeing the test sets e.g y_test, x_test.
Can anyone please help me understand it ?
The terminology sometimes uses validation and test interchangeably which is confusing!
In this case:
Training is carried out on a training set. It does not look at the validation data.
Validation data is used to give you a score at the end of each epoch. It is not used in fitting to update weights.
The problem comes when you adjust hyperparameters such as learning rate based on the validation scores. By doing this you have incorporated validation data into your model and the scores are no longer independent. If you want an unbiased estimate of the final score you would need a separate test set.
.[quote=“simoneva, post:2, topic:4549”]
If you want an unbiased estimate of the final score you would need a separate test set.
[/quote]
That means I should not use test set(x_test, y_test) in validation_data because I want a unbiased estimate of the final score which means I have to split the MNIST data into