Yes, there are different techniques for text generation other than RNN [1].
Few things to clarify:
- ELMo is a word embedding system and not a model. It can be used with LSTM model.
- BERT is a language model based Transformers model, which are different than RNN models.