Move objects without scaling.

When I edit videos, I do a lot of importing and moving images and text inside of the scene of a game. This means that, a lot of the time, I'm scaling objects down so that they fit reasonably inside the scene.

The issue is, if I scale an image down, it ends up with the unreasonably forgiving scaling dots keeping me from being able to actually grab the object and move it.

And, with how much an object moves with a camera as dynamic as most video game cameras tend to be, fiddling with the object coordinates directly is not something I am willing to waste time on.

Is there any way to disable scaling a graphics/text object inside the viewport so that I can drag to move an object around for object animations?