Text show_batch shows only the paddings

[mrfabulous1]

HI NavneetSajwan hope your having a wonderful day!

Some of the posts in this thread may help with your question.

Lesson 8 - Official topic

When I generate a DataBlock for classification for sentiment analysis of the IMDB dataset, I find that my first few batches are almost entirely padding (xpad). But when I train a classifier, I still get an ok accuracy (0.86 after one round of fit_one_cycle) [image] I’ve looked at as many as 50 batches with show_batch, and all but the first batch are entirely padding. Has anyone encountered this? Does anyone have any thoughts on how I can best investigate this further?

Lesson 8 - Official topic

@jaryaman I do not know the answer myself. But … From Chapter 10 information about why this is the case We will expand the shortest texts to make them all the same size. To do this, we use a special padding token that will be ignored by our model. Additionally, to avoid memory issues and improve performance, we will batch together texts that are roughly the same lengths (with some shuffling for the training set). We do this by (approximately, for the training set) sorting the documents by le…

Lesson 8 - Official topic

IIRC it’s actually that there’s one review that’s much longer than the others, so the others have a lot of padding. And only the first few tokens are shown, so the non-padding bit isn’t visible.

Cheers mrfabulous1