contextual taskbar issues

Have you tried pinning it to a specific position if you use it frequently?

The CTB is one of my favourite new features in Photoshop.  It is so clever having exactly what you need as close to the cursor position as you care to make it.  This is especially useful if you use large screens, and begrudge having to move the cursor a millimeter more than you need to.  So, I keep it unpinned so it stays were you park it, and drag it close to the action when needed.  I also use a shortcut to toggle it on and off.  

If it annoys you, then please try and give it a chance.

Well, it's easy to disable permanently if it's in the way. Just click the three dots and "hide".

It's not necessary, there's nothing there that isn't available in the standard toolsets, including (customizable) keyboard shortcuts.