Make Layers Easier to Isolate and move

I am an illustrator and a long-time Photoshop user. I often scan in line art and use Photoshop to modify the drawing and then add layers of color or collage.

I select a layer in the layer panel to move an object in that layer.

Then when I click in my image with the move or selecting tool, if I don't click directly/perfectly on the object in the layer that I have selected, a different object or layer becomes active and moves instead.

The only way to avoid this is if I zoom in to be able to see and click precisely on a small or thin-lined object that I wish to move. I find this very limiting, artistically. I often like being able to see most of the image and how the move or change affects the overall image.

I have worked with layers that contain thin lines and small objects for many years and it used to be that if the layer was selected in the panel/palette that would be the only layer that my actions would affect. I would like that function to return.

I have been noticing this problem for at least a few years and recently realized that I can report it. Currently. I work in MacOS Sonoma 14.2.1 with Photoshop 25.1.0