Photoshop gets frozen

I use Photoshop for digital drawing and I very often drag canvas around and zoom in and out. Doing that for some time leads photoshop to get frozen. It just refuses to use any tools, show or hide leyers. It basicaly stops working but is still open and nothing changes. Good thing in that state I still get access to saving file. Reopening Photoshop fixes it temroraly but it will come again in some time. I thought it might be caused by owerload so I tried to get rid of most of my layers but it keeps happening.
I am tired of this and ask for help