Gradient Tool Shift Not Keeping Gradient at Angle Increments

If you hold down shift before drawing the gradient it does not keep the line at a straight angle. It works if you start to draw the gradient first and then hold down shift though.