It’s not exactly a GAN for text generation but maybe you’ll find ELECTRA interesting. It follows a similar idea since it’s using generator and discriminator models for language model pre-training.
@Richard-Wang recently did some amazing work reimplementing ELECTRA from scratch. He probably can say more about it. See the thread below: