Wacom Tablet not working - 2022 edition

I'm using a Wacom tablet CTL-4100 with PS (2 versions installed for testing 22.4.2 and 23.1). Sometimes, randomly, the click and drag functionality stops working. Basically I can't make strokes. After a few empty strokes, the tablet starts working as normal again. If I use a mouse in that instant, the desired tool application happens as normal as if there's no issue. The pen motion is normal at all times so I can see it move. Its just that strokes don't register with heal/clone/brush or any tool for that matter. Almost like a mouse that's left click has gone bad and the pointer movement is normal. 

Frequency of occurence is roughly once for 10 seconds every 2 minutes of retouching. It automatically comes back to normal but retouching like this is a nightmare. 

Pen works perfectly in other apps I tested with Wacom support. Issue replicates in both versions of Photoshop. Infact, both of my tablets suddenly have this issue.

1. Installed and re-installed latest wacom driver

2. Installed old wacom drivers for testing.

3. Spoke to Wacom support at length. Issue can't be replicated in any 3rd party app so tablet is working as normal without issues. They can't do anything and asked me to speak to Adobe. 

4. Used the famous PSUserconfig method with windows ink disabled (unchecked) in wacom settings to avoid WinInk. Lost all tablet functionality instantly. It acted as a pointer only.
5. Disabled all buttons (ExpressKeys) on the tablet.
6. Updated PS version to latest.

7. Reset brush settings, tool settings etc inside PS.