Constraining multiple values within the speed graph

Looking for some help,

I begin with multiple keyframes selected, then I go into the speed graph. I go to pull the handle to adjust the influence and or easing and I find holding shift before or after I click and drag does not constrain those values to an axis. 

Is there a way to drag those values without having to worry about moving them up or down on the y axis?

Thank you