After Effects Freezes/Rainbow Wheel when Undoing

Working on a project with a lot of Photoshop files. Essentially a 12 fps animation with frames/photoshop files sequenced in compositions, then compositions have some fairly light motion and colour effects (contrast/B&W etc).

Everything runs as expected - except everytime I undo, I get the rainbow wheel for extended periods (5-10min) or it never goes and I have to force quit AE.

Have tried running AE in safemode with preferences reset and 3rd party plug-ins disabled. No difference, undo still takes forever/freezes AE.

Any advice/fixes greatly appreciated as really slowing my workflow or I just avoid undoing where possible and manaully move things back to how they were. Super frustrating. 

AE version 23.6

Macbook Pro 2021 M1 Max 64GB ram 1TB storage

Ventura 13.3.1

Files are on 1TB a Lacie rugged USB-C

Disk Cache is Local on Mac HD