I am having stuttering issues when scaling and positioning my footage

I have decent hardware, i9 12900k, RTX 3070TI, DDR5 RAM. 

My timeline playback runs very smooth, I use proxies afterall, prores at low. The scrubbing is butter smooth. 

However, whenever I try to drag the position, scaling, rotation sliders, I am faced with really bad stuttering and stickiness. This is to say that my hardware is not the issue. 

My original footage is 1920x1080p at 50,000 kbps (once again I'm using prores low proxies) 

I've done all the preference fixes. I've tried moving footage around on my other computer, an old laptop, it was custom adobe footage, and the scaling and postitioning was super smooth. 

I haven't gone around and tried custom adobe footage (those that comes with the program as a template) on my main computer but I'll try that soon. 

My inference is that there's something wrong with my footage? Maybe I'm not matching the sequence settings with the project settings or something like that? 

Any help is appreciated!