I also do not have promlembs with this. It could be a hardware problem or some other utility in your operating system that has a conflict. What operating system are you using, have you tried swapping to a different/external mouse? Does the mouse you have need a driver/driver uppdate.
Untill you find the problem perhapps you could work around it. A usefull shortcut is cmd/ctrl-0 (zero) ro zoom out to fit page/artbaord in window add alt/option (ctrl/cmd-alt/opt-0) to fit spread/all artboards.
Sorry to hear about the trouble you are facing. I would request you to try the following steps and let us know how it goes:
Update macOS to Big Sur or above if not done already
Manually reset preferences & caches: ~/Library/Caches ~/Library/Preferences Rename Adobe InDesign and com.adobe.InDesign to Adobe InDesign.old and com.adobe.InDesign.old and launch InDesign from the Creative Cloud app
Rename the CEP folder to CEP.old from the following location: /Library/Application Support/Adobe
If that doesn't help, rename the extensions folder to extensions.old in the following location: /Library/Application Support/Adobe/UXP