Perfect Playback but Choppy Scrubbing

Hey friends,

I'm hoping to get some insight into an issue I'm having. I don't think it's a bug, but a hardware issue - I'm just not sure what. When I launch a project, it initially scrubs perfectly even with intense codecs (I'm grading All-I 4K FX6 SLOG3 footage). Over time, however, it starts to get choppy but ONLY when scrubbing the playhead PAST A CUT onto a new clip. Again, scrubbing is perfect until it passes a cut. Playback is perfect with no dropped frames. The issue gets worse and worse over time as I'm editing to the point where every time I scrub the playhead past a cut it hiccups for a second or two. As you can imagine, this is incredibly annoying and time-wasting when trying to scrub through timelines. Even much lighter EOS R 1080p footage still does it, albeit much faster.

I'm not sure what the bottleneck is. I thought it might be my slow SSD but I recently tried an NVMe SSD that has killer write speeds and, while it was a little bit better, it still ended up slowing down. I also thought maybe it was my computer's RAM (I have an M1 Max MBP with 32GB of RAM). When I close the project, restart the computer, and open the project again it right away scrubs smoothly again. Everything is up to date - both computer and software. I've attached a video for reference.