How to disable the movement of a layer from the image window?

Hi, I get a silly issue, but it's making me waste a lot of time. Even when I have a layer selected and try to move it, if I click on another layer inside the image window, this other layer gets selected and it's the one that moves. Where do I disable it? I want to keep moving only the layer I select on the layer menu, no matter where I click inside the image window. Thank you!