I've Noticed this weird behavior after the latest 21.1.0 update:
When panning, the canvas basically refreshes only after I have stopped my panning motion, so that there's no smooth movement during panning, only the state before panning and the state after panning. Feels extremely choppy. Only if I scroll REALLY slowly - like snail speed - I see the canvas following along my motion. As soon as I accelerate to a normal panning speed, the above behavior goes into effect.
I first thought that this might be a graphics card driver issue but then I noticed that when I turn on "flick panning" in the preferences, suddenly panning is performed smoothly (but, as to be expected, with the annoying floaty overshooting motion of flick panning, that I'd like to avoid).
If someone can confirm, this might be an issue worth investigating.
UPDATE 20th April 2021:
At least two users confirmed that the Navigator window plays a role in this problem. Scaling the Navigator window or closing it completely stops the problem from occurring in those cases.
Apart from closing the Navigator window and activating "Flick Panning", another workaround seems to be to activate "Scroll All Windows" in the options of the Hand tool. This also stops the undesired behavior but obviously comes with potentially unwanted side effects.