HELP! - Height map disapearing on building faces. But fine on others when exported to UE5

Hello, I got some models Ive been knocking out. I did some smaller versions they look fine. For some reason the large one in unreal is giving me some face issues like its not reading the height map on my buildings and causing them to look wrong. I have tried many varients of exporting the model different. Here on the left is a quads version. on the right its a Triangles version. The thing that is annying is it looks perfectly fine in substance painter. Anyone hit this issue before? Any assistance is greatly appreciated!

If it helps seeing my normal maps are all facing out correct too. So it doesn't appear to be normal maps. (This is a versionw here I used N-Gone tool) I have a version where faces are all still quads. Same results.