Tags instead of Categories

This is my first post on the forum. What an amazing tool this is!

I have a use case for ULMFiT in which I have text descriptions that I want to “tag” with one or more categories. Each job description can be in one or more categories, unlike a standard categorization, where the text can only be classified in a single category.

Is there a good way to handle this in ULMFiT?
Options that come to mind are:

  1. Run the categorization separately for each category, where the options are “in this category” and “not in this category”.
  2. Make each possible combination of tags be a category.

I think 1) is probably the best, and will try both ways, but would love to hear your thoughts.