Remove Tool gets stuck on loading and doesn't work

This has been happening for a while, used to happen with Beta version and still happens on the last stable release too.
 

Sometimes, after using Remove Tool for a while, it starts “freezing” like this, I will select what I want to remove and when I hit Ok, it doesn’t load, it doesn’t do anything.

Video recording: https://buzzheavier.com/kil2r1x188v4
 

Then after that, If I close Photoshop (even If continue using other tools), it will freeze and not respond anymore, I have to force quit. 

I’m running Photoshop 27.6.0 - MacOS M4 - Tahoe