Using transformers with fastai v2

Yes indeed.

For the metrics, you need to write your functions that delegates the mask part to the function you want.