Sky Replace Scale Issue

When I use Sky Replacement, one of the difficulties I face is that the "sky" photo  - which may be a portait photo - is automatically scaled to fit the sky area of a landscape photo. When I reduce the scaling of the sky, you can see outside of the replacement "sky" photo, which then means I have to crop the landscape photo.

What I want to do is have the ability to fit the "entire" portrait image of the sky to fit the entire sky area of the landscape photo. Is there a way that this can be achieved?