Xx.. labels in Language modelling

[vladgets (Vlad Getselevich)]

Where I can find explanation of meaning for each of the “xx…” labels in Language modeling:
‘xxunk’,
‘xxpad’,
‘xxbos’,
‘xxeos’,
‘xxfld’,
‘xxmaj’,
‘xxup’,
‘xxrep’,
‘xxwrep’,

[sgugger]

Those are the special tokens, detailed here in the docs (scroll a little bit down).