In theory, you could try to recreate each part of the image behind him using stills. But the added complication of the handheld camera means you will struggle to get a good result.
But try this:
- Track the footage using the included Boris Mocha AE tracker. For a position data track.
- Take stills from before and after he passes through the view.
- Use the tracking data to link these stills to the background, so they move with the wobble.
- Use his black shape as a track matte for the stills. If that works, then you'll need to try fading or wiping between the two stills.
( Swear next time to include a helper to block people moving infront of the camera and use a tripod. 😂)