Hi, I’d like to get rid of the special tokens in the Textblock, how to do that?
‘xxunk’,
‘xxpad’,
‘xxbos’,
‘xxeos’,
‘xxfld’,
‘xxmaj’,
‘xxup’,
‘xxrep’,
‘xxwrep’,
btw, what should be the format of vocab? thanks.
1 Like
Hi, did you ever figure this out?