There are few resources for this. One is from this post where tabular and text is combined for Spanish
I also figured a way to combine metadata (numerical and categorical) with text and tested it out with some Kaggle dataset and it seems to work. I hope it’s somewhat related to your case