"Fit" detail view often not fitting

The default zoom-to-fit detail view will often end up not actually zoomed-to-fit. I am not sure exactly how to reproduce this, but I will often get into a state where it will be centered around whatever the center was when zoomed in. Toggling between fit and zoomed in will zoom in or out as usual, but when zoomed out, it much of the image will be outside the viewport. It is then impossible to actually scroll to bring it back in, because arrow keys and two-finger panning will go to other photos instead, and click-dragging will just switch to the zoomed-in view.

This is on macOS 12, Lightroom 5.1 (20211204-1710-0e71941).

I will update this thread with repro steps, if I figure out any.