object-aware geometry

I very often need to adjust the geometry of a picture such that a discernible object in the picture (say a frame, or a building) becomes rectangular; the rest of the picture should be adjusted accordingly. Quite frequently the automatic adjustment in Camera Raw fails, arguably because it searches for right angles in the complete picture, rather than the object of interest. What would be needed is straightforward: Camera Raw already comes with a powerful object selection tool. All that would be needed is the ability to adjust the complete picture conditional on the selected object being reactangular. (I know there is the manual option, with Shift + T on a Mac, but this is not only laborious. It also frequently is imprecise, as I need to do the manual correction while zooming out to the full picture, and then am not precise enough)