Are you using a style reference or structure reference? I generally have not experienced this with a structure reference as it seems to follow the guidance of the structure. If that is the case, try increasing the strength of the structure:
If not using a structure reference, there is no perfect way to fix this. These things can help...
Use:
If a person, say "full body shot"
I will also use "Zoomed out", "Ultra wide angle"
sometimes changing the aspect ratio can help.
I have found using a structure reference, even a sketch, can help.
I would be interested to hear from others on techniques that work for them.
@Gerard373106107zua are you matching the same proportional size with your output (square, portrait, widescreen, etc)? I've noticed this if I'm using a portrait reference source and a widescreen or landscape orientation in Firefly.