3D Camera Tracking + Time Dilation Effect - Need Help with Complex Camera Movement

What I've Accomplished:

I've successfully created a time dilation effect with simple panning shots using this workflow:

1. Track and stabilize the background
2. Apply time dilation to moving subjects (which correctly positions them in 3D space)
3. Reverse the stabilization to get the final composite

This works perfectly for simple camera movements. You can see the results in the before/after images attached.

Current Challenge:

I'm now trying to achieve the same effect with a more complex camera move - specifically a camera that's both pushing forward and panning while subjects move through the scene.

Technical Setup:

• I've successfully tracked my camera data
• Created a ground plane and null object
• Attached a tracking shape to my null (visible as the white box in Image 1)

What I Need Help With:

I need to stabilize the footage so that:

1. The tracked shape (white box) remains perfectly static in 3D space from first to last frame
2. The footage should rotate and move around this fixed point to maintain the shape's perspective
3. When I later apply time dilation and reverse the stabilization, subjects will appear in their correct 3D positions regardless of when they appear in time

For example, if a roller skater is time-dilated so much that they appear in frame 1 when they should be far down the path (as in frame 100), they should still be positioned correctly in 3D space.

Any suggestions on how to achieve this stabilization with a moving camera would be greatly appreciated!