How do I reliably select a text comment?

OK, so I've created a text comment. How do I reliably select it so that I can move it, or grab its handles and resize its box? I find that by randomly clicking on, or near the comment, eventually/sometimes the box handles and/or the "move" mouse cursor will show up. But I can't get this work at all reliably.

Do I have to de-select the text comment tool first? If so, what's the best way to do so? Do I need to select the main selection tool?