Saving fastai model and loading it with pytorch


I’m thinking about using my fastai model for inference. I think that it will be faster to use plain pytorch.
I can save model.state_dict() of my fastai learner using pytorch, but how can I load it? I need to have the same model representation as in fastai, but how can I move my AWD-LSTM with head classifier to pytorch?

Best regards