Skip to main content
Inspiring
November 24, 2017
Answered

object removal and matchmove in AE

  • November 24, 2017
  • 3 replies
  • 682 views

Hey, everyone!

I'm asked to remove an object from the ground plane, from a 4k Arri Alexa footage. My first instinct is ofcourse to use AE and mocha. I get a good track, despite quite quick camera movement (pull back and tilt). However when I started creating mattes and patches things started to fall appart, due to parallax i can clearly see the 2d patch in the background. Although it tracks well the composit doesnt look solid... this goes for transformation data from mocha, and as for the corner pin, it looks great with the grid effect applied, when i try to put a texture onto it, it becomes flat and the result is even worse than that in the first method.

Does anyone have any idea or suggestion on how to make this patch more realistic/3d'ins? Maybe I missed something in my approach with the tools Im using?

Thanks!

    This topic has been closed for replies.
    Correct answer valm98140710

    Yes, totally forgot to follow up! I found sort of a solution, it still isnt perfect especially for large perspective changes with a lot of motion blur (which was the case for me), but the result is decent, and quicker than going full 3d...

    I used mocha to track the ground, then picked up a frame with least amount of motion blur, aligned the surface grid (button just below layer panel in mocha) to the size of the shot, and then applied the corner pin data in AE to a still on that specific frame I picked, in which I removed the unwanted stuff (in PS). Obviously I lost some resolution, but little sharpening pretty much fixed it.

    3 replies

    Kevin J. Monahan Jr.
    Community Manager
    Community Manager
    December 15, 2017

    Hi ValM,

    Are you still having this problem or are you clear of it? Let us know.

    Thanks,
    Kevin

    Kevin Monahan - Sr. Community and Engagement Strategist – Adobe Pro Video and Audio
    valm98140710AuthorCorrect answer
    Inspiring
    December 15, 2017

    Yes, totally forgot to follow up! I found sort of a solution, it still isnt perfect especially for large perspective changes with a lot of motion blur (which was the case for me), but the result is decent, and quicker than going full 3d...

    I used mocha to track the ground, then picked up a frame with least amount of motion blur, aligned the surface grid (button just below layer panel in mocha) to the size of the shot, and then applied the corner pin data in AE to a still on that specific frame I picked, in which I removed the unwanted stuff (in PS). Obviously I lost some resolution, but little sharpening pretty much fixed it.

    Kevin J. Monahan Jr.
    Community Manager
    Community Manager
    December 15, 2017

    Thanks for circling back. I hope it will help others.

    Cheers,
    Kevin

    Kevin Monahan - Sr. Community and Engagement Strategist – Adobe Pro Video and Audio
    Mylenium
    Legend
    November 24, 2017

    Without seeing your footage nobody can tell you much. Tracking is just one side of the equation. from your description it simply sounds like you're totalyl ignoring that a different glancing angle changes the "shading", e.g. wet surfaces looking darker and less glossy when viewed straight on instead of at an angle. If you get a clean track, you probably need to work on some animated color corrections and additional stuff. And no, 3D is not the answer here - unless you have a "real" 3D program with elaborate layered texturing options and an advanced renderer, a simple AE 3D layer will look just as rubbish.

    Mylenium

    Community Expert
    November 24, 2017

    It's very hard to make suggestions without seeing the video because every shot is different. Maybe some Advanced Corner Pin tracking and replacement will help. Check out this tutorial for the basics. What you do is corner pin track the area you want to replace and then lock it in place so you get a fixed area that you can work with, then you reverse the corner pin to bring the fix back into the frame and make it stick. This tutorial will give you the basics:

    You can use this technique for all kinds of shots. Maybe it will give you some ideas.

    If you can post a link to the video you are working with I can give you some more detailed suggestions.