Thanks for the update @Łukasz Pogoda one thing we see:
Vendor name: NVIDIA
Driver date: 2023-05-24 000000.000000-000
Driver age: 2 months
Driver version: 31.0.15.3598 - it is alwasy best to make sure you drivers are up-to-date, we have had other customers who say:
"Download the Studio Driver from NVidia (I am using v531.61 which is not the latest but I know it is stable on my RTX3090) When installing select Advanced Options - Clean Install. That will overwrite remnants of any old drivers.
Do not install GeForce Experience, that is for games. For Photoshop you don't need it."
Also, make sure you are using the most powerful GPU, not both:
https://helpx.adobe.com/photoshop/kb/troubleshoot-gpu-graphics-card.html#multiple-gpus