Why are there additional movements in between key frames?

I am trying to move an object from point A to point B, however, I keep running into this problem where my object makes additional movements in between key frames. I never turned on easing and am using standard linear key frames. Why does this keep happening?

Here is a shot of the graph editor, which illustrates the extra movement that I cant eliminate,