Engine gimble when not in use/and gyro issue

1. Launch spacecraft into space
2. turn off engines

On this particular craft it stops pointing in the direction of flight eventually settles pointing backwards. Something to do with the gyro I guess. More importantly I can see the engine gimble is active even though the engines aren't firing, like it's attempting to fly forwards.