Angle tool in the way of moving points

Hello everybody !

The angle tool was a great addition a few years ago. It saved me a lot of time on various illustrations and graphics. But it also come with a drawback which I'm tired of and can't seem to find a solution. Let me explain.

When I try to move a lots of anchor points with the direct selection tool (white arrow), the white dots of the angle tool are often prioritized and prevent the movement. This happen mainly when I'm zoomed out and all the point are overlapping. I got to zoom in close to the points to precisely select one black anchor point.

Is there a way to ignore those angle dots when trying to move ? I don't really want to deactivate the tool since it's very handy.

Thanks for your input !