I need to use a video as a background on another video. Is that even possible?

[nima_Mousavi6901]

Hello everyone,

I am an architecture and 3d visualizer. I created an animation from a model I am working on.

I want to mix this animation, which I created in 3D software, with real footage captured by drone from the real neighbor. I am not sure if this is even possible in Adobe Premier Pro.

I am using Premiere Pro and AE for merging videos and setting transitions only, so technically I am noobie noobie on the software.

 

 

As you can see in the upper images,

the first one is a screenshot of my 3d animation and the next one is a drone video from the neighbor.

I want to swap red-noted parts in a way that my final video shows the balcony from 3d animation and the background from the drone footage (instead of white cubes)

Note that both files are moving shots and not a fixed camera.

If this kind of task is possible in AE.

A video of two clips merged is uploaded.

I already posted this in the Premiere forum but not sure which software is the right one.

Thank you in advance!

Nima

[Rick Gerard]

If there is camera movement, you need to track the camera. If there is movement in both shots, you must stabilize one of the shots. It is usually the background shot that is motion stabilized. Motion stabilized means that the movement of the surface (building, tree, or horizon) in the shot that closely matches the primary point where the shots match up does not move at all.

Then, a mask must be created on the foreground shot to poke a hole in the background. Sometimes, this mask needs to be animated. It all depends on the amount of camera movement. 

The last step is adding the camera movement to the background plate (your second screenshot). Color grading, motion blur, and edge refinements are usually required to make the final composite believable. 

I don't have a specific tutorial that will work for your shot, but here is one that shows one approach using Mocha AE for the tracking and a still image for the background replacement. Maybe it will give you some ideas. 

[thepixelsmith]

The initial question was whether it is possible to do this in Premiere Pro, but this is really a task for After Effects.

What Rick said is basically true: the difficulty of mixing footage depends on the amount of movement in the background plate (the neighborhood video). If there is no camera movement, then tracking and stabilizing are unnecessary, and you could simply use masks to composite the video together. So, if there is no movement in either shot, you could perform the masking in either After Effects or Premiere Pro.

The challenge in a situation like this is that even if there is no camera movement, it is unlikely that the size and perspective of the 3D elements will match the background plate (the neighborhood).

The standard workflow I am familiar with in After Effects for integrating 3D elements with live footage involves either importing the 3D models directly into After Effects (they must be in GLB, glTF, or OBJ formats, and your After Effects version must support Advanced 3D) or using the background plate video as a reference for modeling in your 3D software.

The workflow for the second option varies significantly depending on whether the background plate has camera movement and the specific 3D software being used.

[nima_Mousavi6901]

Thank you both for your recommendations and clarifications.

I wanted to take a new drone footage after checking the possibility of such an edit in Adobe.

However, after your explanations, I understand that this is not a task for me, especially given this deadline period.

Anyway, I managed to model the neighbor and I think it was a tough but rational decision.

Again, thank you for your responses. I will try to learn both AE and Premiere for further projects. Cool software since I am creating videos for my projects nowadays.

Thanks,

Nima