@Kaspar suggested some hyperparameters for training TransformerXL in this thread:
https://forums.fast.ai/t/training-transformerxl/40104/15
1 Like
@Kaspar suggested some hyperparameters for training TransformerXL in this thread:
https://forums.fast.ai/t/training-transformerxl/40104/15