I was trying to train a char level RNN on some python scripts to see how it learns the structure of the code. With time it is learning the syntactic structures, but I think it will be better if we train it on an AST instead, cause then instead of wasting time figuring out the next character, the RNN could learn the token sequence.
Another wild thought, is there a way to add logic to NN as well, like adding some kind of intelligence?
This is a cool idea. Maybe it would incorporate well in genetic programming or other evolutionary techniques as a more informed search or mutation operation?