Reinforcement learning for combinatorial optimization (Help with PhD research)

Sounds like a great project!

Have you read the classic RL book by Sutton & Barto?