After trying everything I think I stumbled into a combination of settings that achieves what i needed.
I am not entirely sure which part did the trick and Im too afraid to try to experiment in case i break it again.
So my final set of settings:
- using wacom “Erase” option on the pen instead of keystroke “E”
- In photoshop change keyboard shortcuts → tool section → “decrease brush size” and “increase brush size”. Pick two random unoccupied keys i selected ‘Y’ and ‘K’
- If you are used to using wacom table wheel (aka touch ring) to change size change it to use Y and K.
Done!
Now when I hold down “Erase” button on my wacom pen and click Y or K (or use the wheel), I can change eraser brush without switching to it permanently.
Hopefully someone finds it helpful in the future. And maybe Adobe can look into which part of their app didnt allw me to do the same thing with ‘[‘ ‘]’ and ‘E’
Thank you @davescm and @creative explorer for trying to find a solution as well!