Timeline sped-up, but nothing fixes it

I've had an issue for years, and that only became worse and worse over time.

While working on my project, at some random point in time my timeline speeds up, preview play speed is too fast. The only workaround I've found to correct this is to select the input audio hardware to "none", and then the speed is correct again. Only problem is: 50% of my job in Premiere consists in recording a speech while editing the images, I cannot work without audio input, It's the whole point of working with Premiere for me. And while in this glitched sped-up state with the mic on, recording does not work anyways.

I've check that both audio input and outputs share the same frequency (44100 Hz in my case), and closing/reopening Premiere does not correct it. Only solution: rebooting the computer to have everything working again: normal timeline speed and the possibility to record audio.

But nowadays I'm now rebooting my PC like 5 times a day to correct this issue, it's getting ridiculous.

Do you guys have any idea how to correct this problem please ?

My version of Premiere: 25.5.0 build 13, but bug has been present for years. I'm on Windows 10.
Hardware: in: BIRD UM1, out: bluetooth headset (same effect on speakers).