Skip to main content
Known Participant
April 10, 2019
Question

Remove a menu—Content Aware Fill

  • April 10, 2019
  • 1 reply
  • 244 views

I have a video that has an overlaid menu that popped up for about thirty frames when the video was created.

I'm trying to remove the static menu.

The image behind the menu is changing while the menu is on the screen, and there is no image that has a picture of what it looks like behind the menu while the menu is on the screen. The image across the whole frame has motion graphics sweeping across it, and these pass behind the menu while it is present.

I can't get a good approximation of what is behind the menu. Is the algorithm that content-aware employs not able to address this particular problem? I can imagine that not being the case, but I'm not finding enough information about it to judge it one way or the other.

Thanks

Robert

    This topic has been closed for replies.

    1 reply

    Known Participant
    April 11, 2019

    This sequence illustrates my description.

    The menu "PLAY DVD" is in the upper right.

    I've made a mask of it.

    The first three frames show images from the clip's sequence.

    The last two frames show the fill generated. Note that they are just "smears" of pixels.

    Is this example just a special case that "Content-Aware" can't do, or have I made a mistake in my procedures?

    Thanks in advance.

    -Robert

    Community Expert
    April 11, 2019

    Robert_Edgar Your project is a perfect example of a time when you need to create reference frames. The hard black edges are throwing the predictions that content aware fill is trying to make.

    I would start the content aware fill where the first image just touches the first image, then add as many as are necessary to clean up the rest of this clip.

    The video you are trying to repair is not a normal shot by any means so the predictions are not going to be very accurate. That's why you need to include a bunch of reference frames. There are some pretty decent tutorials on how to fix those kinds of problems.

    Known Participant
    April 21, 2019

    Thanks. I will try them out.

    Since there is no constant background, and the lines move across the background creating unique images every frame, I can see why it would be difficult for an algorithm to predict what a given frame would look like in back of the icon.