"Not Enough Ram" error when using the remove tool

When removing blemishes on a blank layer above the background layer but below a black-and-white layer, my computer freezes for a minute or two and gives me a "not enough RAM" error. I've monitored the system performance — the RAM usage typically operates at 16–20 GB under normal workload but will suddenly spike to 100% (64 GB) and freeze. If I'm lucky, it will recover, and I can continue. If not, Photoshop crashes, and I lose all my work.

Win 11 

13900K (not overclocked)

64gb ram using XMP profile 

GTX370 (not OCd)