Hi, I finetune gpt-2 model based on Tutorial - Transformers
Now I want to generating text and when I generate text with GPT-2 model sometimes the last sentence is not a proper sentence for example :
Once upon a time, there was a group of new immigrants and their son who at the beginning of World War II once began a long run of the most inhumane abuse they had been involved in. At the age the so-snappy, one
I wonder is there a way to handle this issue.I’ve checked Preprocessing data and used different values for
truncation but the problem still remains the same.
also, I tried to use
<|endoftext|> in the tokenizer but it didn’t work.
Note that I use transformers generator for this
any help would be appreciated.