Slow-mo and Stabilizer causing frame lag

I've nested my clip, after adding slow-motion and ramping it, and changing the time interpolation to 'Optical Flow'. I then added 5% warp stabilize, not much at all. I used 'Subspace Warp' for the method, and 'stabilize, crop, auto-scale' for the framing. The clip is of my friend doing a trick on his snowboard while jumping over me, so he's moving really fast through the air, and I am also  moving to keep him center frame on my fisheye lens, so, there's a lot of movement going on, thus why I need it to be stabilized. When I add the warp stabilizer, it looks like the shutter speed slows down and lags/clip looks jumpy, at the time when the clip ramps, while its at the slowest point, and then again as it ramps out back to full speed. I have no interest in compromising with my clip speed, or ramp positioning, I'd rather just not use warp stabilizer if that is my only solution. BUT if anyone has had this issue, and knows how to fix it, please let me know. I've done this process to a few clips, and it's been working fine after I render everything, but for some reason it's causing me problems on this one clip, maybe because there's so much quick movement. PS, the clip was filmed at 1080/60fps, so this is an adobe premeire issue, not an issue with shutter speed. Don't forget, I already used 'Optical flow' and this is still an issue!