Need your guidance - Keras over GPU

When i run a program written in Keras with Tensorflow backend on gpu it runs way slower than the same program run on CPU, not sure the reason for it? I thought running the program on gpu should be faster compared to CPU, please advise.

Many thanks in advance.

Saurabh Jha