The problem of disappearing details

Hi
I wanted to ask about generating material from a single photo using the Image to Material (Al Powered) method.
Example:
If environment rotation is set to 0.5 it is ok.
If I shift the environment rotation to 0 or 1, it loses detail.
It looks as if for a certain light incidence account there was missing information about what should be displayed.
Can this be improved in any way?
Thank you, best regards, Arek
---------------------------------------

------------------------------------