Orbit tracks require a fixed spatial orientation. It's pretty much the one scenario no semi-automatic tracker can do correctly instantly for the simple reson that the same features can tilt into frame from the opposing ends and the tracker can't make sense of it. You may simply need to add a ton of extra manual markers, track the segments individually and then patch them together/ smooth out the tracker curves. Other factors like drone vibrations, unwanted sideways camera movement and rolling shutter may of course add to the problem. Other than that the shot looks good enough in terms of distinct trackable features. It may just need a lot more attention and manual labour.