Improved Time Remapping

I really struggle with the Time Remapping functionality. I wish I could grab a frame in the middle of a clip and then position it where I want that frame to be in the timeline. Premiere Pro should figure out the interpolation between the frames.

Right now, I want to slow down a 360° product video until it halts and ramp it up again after a few seconds until the rotation of the product halts again at a certain position. This is a pretty laborious task right now. I want things to behave more predictably.