I'm having the same issue & the batch processing window stays on top of every every program so I have to move the batch window out of sight so that I can work other programs.
Even when the batch processing is finished, the window stays on top & if I start another batch process I now have two batch process windows open. Every now & again I have to close Photoshop altogether to clear up the batch windows. I'm on iMac M1 version Monteray.