Value Graph

If you want to manipulate speed you edit the speed graph. Editing the value graph will change the position. Maybe this tutorial will help:

I occasionally edit the Value Graph when I am editing rotation or Time Remapping, but for controlling the timing, the speed graph is the tool of choice.

If that does not solve your problem we need a detailed description of your workflow and design goals so we can help you work out the most efficient solution.