Randomness in training the model

When I train the model with 4 cycles, the first cycle starts with a random number between 0.07 and 0.03 and then the next cycles, it decreases or increases depending on the value it started with. So basically I have to reset the model 10-12 times before getting it to start with 0.3. Is this normal?