Check out the discussion here:
If there’s a PyTorch implementation, you can use it. The challenge is getting the rest of it working too, which is also a problem with integrating it itself into the library. There’s too large of a difference between the models IMO and the support needed for them to have them all on hand like ResNet. However, that doesn’t mean it can’t be done 