Highlighted

Feature Focus: Roto Brush 2

Adobe Employee ,
Jun 23, 2020

Copy link to clipboard

Copied

Hello Beta Testers!

We are pleased to inform you that Roto Brush 2 is now available for beta testing in the 17.1.2x32 build of After Effects (Beta). This new propagation engine incorporates the technology behind Project Fast Mask from MAX 2018 to streamline rotoscoping/isolating a subject or object from a background.

 

The amazing notiansans from Learn How to Edit Stuff has created a great tutorial video for Roto Brush 2 in After Effects (Beta) showing the basic workflow as well as a comparison with original Roto Brush.

 

What We Need From You

We are looking primarily for feedback on how the new propagation engine is performing with real-world footage, though all feedback is welcome. Your testing efforts and input are highly appreciated.

 

If you are willing and able to share footage with the After Effects team where Roto Brush 2 is having difficulty isolating a subject when propagating, please follow these steps to submit the footage and project:

  1. In the Project panel, select the composition that contains the footage with Roto Brush applied.
  2. Go to File > Dependencies > Collect Files
  3. In the Collect Files dialog:
    • Set "Collect Source Files" to "For Selected Comps"
    • Enabled the "Reduce Project" checkbox
    • Click "Collect" and select a location to collect the project file and footage
  4. Zip up the folder containing the newly-collected project and footage.
  5. Add the .zip to your Creative Cloud storage ( or Dropbox, OneDrive, etc ) and email a link with a brief description of what you were experiencing to rotobeta@adobe.com. All footage submitted will be kept confidential and will not be shared with third-parties.

Getting Started with Roto Brush 2

The application of Roto Brush with the new propagation engine is largely the same as in previous After Effects versions:

  • Select the Roto Brush Tool in the toolbar ( Alt/Option + W ).

    AfterFX_(Beta)_2020-06-11_14-40-00.png

  • Double-click on an existing layer in the Composition panel. This will open up the layer in the Layer panel.

  • Paint a green foreground stroke on the subject, object, or region you are attempting to roto. Avoid painting across edges as this might confuse the selection. This creates a base frame ( visible as a blue highlight in the Time Ruler of the Layer panel. )

    2020-06-11_14-54-41.gif

  • Refine the selection by painting additional foreground strokes, or paint background strokes by holding Alt/Option to remove portions of the selection.
    Foreground stroke, adding to selection:

    Foreground Mirror Smaller Brush sm.gif
    Background stroke, removing from selection:

    tehbhaexr0yc.gif

  • Once you are happy with the selection on the base frame, press the Spacebar to start propagating the selection through the footage. This will trigger the propagation of the matte from the base frame to the new frame. You can also use Cmd/Ctrl + Left/Right arrows to propagate frame-by-frame either forward or backward, if you would like to go slower and evaluate the propagation more closely. This might be more ideal for footage which requires more correction strokes.

  • After you have propagated the matte through all of the video frames you need and you are happy with the result, you can freeze the propagation using the Freeze button at the bottom of the Layer panel. After freezing, you can still make adjustments to the matte itself in the Roto Brush effect without re-propagating. If you need to add or remove from a selection after freezing, you can unfreeze the propagation with the same button.

 

Correcting the Roto Brush matte:
As Roto Brush propagates the matte from frame to frame, the selection may start to include unwanted regions or "lose" portions of the original selection. To correct this, paint a background stroke ( holding Alt/Option ) on the first frame where the unwanted change occurs to remove unwanted regions, or paint a new foreground stroke to include anything that was missed. As with the base frame, avoid painting across the edge of the selection as much as possible.

Adjusting and Refining the final matte:
The result of the propagation can be further refined and improved via the controls in the "Roto Brush Matte" group in the Roto Brush effect, especially with the "Reduce Chatter" property. Additionally, the Refine Edge Tool can be used for highly-detailed edges like hair and further controlled in the "Refine Edge Matte" property group. There are also options that compensate for motion blur and decontaminating edge colors.

Use the toggles at the bottom of the Layer panel to view the matte results, or open the Composition panel to view the result in-context with other layers.

 

Toggles in Layer panel for viewing alpha, alpha boundary, and alpha overlay

AfterFX_(Beta)_2020-06-11_17-25-21.png

Additional Resources

For more details on the Roto Brush workflow, below you'll find links to both Adobe documentation as well as tutorials from Roto Brush users.

Please note: Due to the enhancements in the new version, some of the tutorials may be outdated or encourage practices which may not yield the best results. For example, painting very close to an edge may result in a poor result if any pixels from the background are accidentally included in a selection.

 

Thanks very much for trying out After Effects (Beta) and Roto Brush 2!

TOPICS
Feedback

Views

9.4K

Likes

Translate

Translate

Report

Report
Community Guidelines
Be kind and respectful, give credit to the original source of content, and search for duplicates before posting. Learn more

Feature Focus: Roto Brush 2

Adobe Employee ,
Jun 23, 2020

Copy link to clipboard

Copied

Hello Beta Testers!

We are pleased to inform you that Roto Brush 2 is now available for beta testing in the 17.1.2x32 build of After Effects (Beta). This new propagation engine incorporates the technology behind Project Fast Mask from MAX 2018 to streamline rotoscoping/isolating a subject or object from a background.

 

The amazing notiansans from Learn How to Edit Stuff has created a great tutorial video for Roto Brush 2 in After Effects (Beta) showing the basic workflow as well as a comparison with original Roto Brush.

 

What We Need From You

We are looking primarily for feedback on how the new propagation engine is performing with real-world footage, though all feedback is welcome. Your testing efforts and input are highly appreciated.

 

If you are willing and able to share footage with the After Effects team where Roto Brush 2 is having difficulty isolating a subject when propagating, please follow these steps to submit the footage and project:

  1. In the Project panel, select the composition that contains the footage with Roto Brush applied.
  2. Go to File > Dependencies > Collect Files
  3. In the Collect Files dialog:
    • Set "Collect Source Files" to "For Selected Comps"
    • Enabled the "Reduce Project" checkbox
    • Click "Collect" and select a location to collect the project file and footage
  4. Zip up the folder containing the newly-collected project and footage.
  5. Add the .zip to your Creative Cloud storage ( or Dropbox, OneDrive, etc ) and email a link with a brief description of what you were experiencing to rotobeta@adobe.com. All footage submitted will be kept confidential and will not be shared with third-parties.

Getting Started with Roto Brush 2

The application of Roto Brush with the new propagation engine is largely the same as in previous After Effects versions:

  • Select the Roto Brush Tool in the toolbar ( Alt/Option + W ).

    AfterFX_(Beta)_2020-06-11_14-40-00.png

  • Double-click on an existing layer in the Composition panel. This will open up the layer in the Layer panel.

  • Paint a green foreground stroke on the subject, object, or region you are attempting to roto. Avoid painting across edges as this might confuse the selection. This creates a base frame ( visible as a blue highlight in the Time Ruler of the Layer panel. )

    2020-06-11_14-54-41.gif

  • Refine the selection by painting additional foreground strokes, or paint background strokes by holding Alt/Option to remove portions of the selection.
    Foreground stroke, adding to selection:

    Foreground Mirror Smaller Brush sm.gif
    Background stroke, removing from selection:

    tehbhaexr0yc.gif

  • Once you are happy with the selection on the base frame, press the Spacebar to start propagating the selection through the footage. This will trigger the propagation of the matte from the base frame to the new frame. You can also use Cmd/Ctrl + Left/Right arrows to propagate frame-by-frame either forward or backward, if you would like to go slower and evaluate the propagation more closely. This might be more ideal for footage which requires more correction strokes.

  • After you have propagated the matte through all of the video frames you need and you are happy with the result, you can freeze the propagation using the Freeze button at the bottom of the Layer panel. After freezing, you can still make adjustments to the matte itself in the Roto Brush effect without re-propagating. If you need to add or remove from a selection after freezing, you can unfreeze the propagation with the same button.

 

Correcting the Roto Brush matte:
As Roto Brush propagates the matte from frame to frame, the selection may start to include unwanted regions or "lose" portions of the original selection. To correct this, paint a background stroke ( holding Alt/Option ) on the first frame where the unwanted change occurs to remove unwanted regions, or paint a new foreground stroke to include anything that was missed. As with the base frame, avoid painting across the edge of the selection as much as possible.

Adjusting and Refining the final matte:
The result of the propagation can be further refined and improved via the controls in the "Roto Brush Matte" group in the Roto Brush effect, especially with the "Reduce Chatter" property. Additionally, the Refine Edge Tool can be used for highly-detailed edges like hair and further controlled in the "Refine Edge Matte" property group. There are also options that compensate for motion blur and decontaminating edge colors.

Use the toggles at the bottom of the Layer panel to view the matte results, or open the Composition panel to view the result in-context with other layers.

 

Toggles in Layer panel for viewing alpha, alpha boundary, and alpha overlay

AfterFX_(Beta)_2020-06-11_17-25-21.png

Additional Resources

For more details on the Roto Brush workflow, below you'll find links to both Adobe documentation as well as tutorials from Roto Brush users.

Please note: Due to the enhancements in the new version, some of the tutorials may be outdated or encourage practices which may not yield the best results. For example, painting very close to an edge may result in a poor result if any pixels from the background are accidentally included in a selection.

 

Thanks very much for trying out After Effects (Beta) and Roto Brush 2!

TOPICS
Feedback

Views

9.4K

Likes

Translate

Translate

Report

Report
Community Guidelines
Be kind and respectful, give credit to the original source of content, and search for duplicates before posting. Learn more
Jun 23, 2020 4
Community Beginner ,
Jun 27, 2020

Copy link to clipboard

Copied

I'm having trouble testing Roto Brush 2. It loses the selection  from 2 frames,  but  when I switch to Roto brush 1.0 everything is OK... I use Mac Pro (2013 ) OSX Moajve 10.14.6.

Likes

Translate

Translate

Report

Report
Community Guidelines
Be kind and respectful, give credit to the original source of content, and search for duplicates before posting. Learn more
Reply
Loading...
Jun 27, 2020 0
Adobe Employee ,
Jul 14, 2020

Copy link to clipboard

Copied

Hi woytekz,

I'm sorry to hear that Roto Brush 2 loses the selection so quickly on your footage. Would it be possible to send a collected project with the footage to rotobeta@adobe.com? A screen recording on the behavior would be helpful as well so the team can see how the new Roto Brush propagation engine is falling down. Additionally, what GPU is being used in the 2013 Mac Pro?

 

Thanks very much for any further information,

- John, After Effects Engineering

Likes

Translate

Translate

Report

Report
Community Guidelines
Be kind and respectful, give credit to the original source of content, and search for duplicates before posting. Learn more
Reply
Loading...
Jul 14, 2020 0
Community Beginner ,
Jul 20, 2020

Copy link to clipboard

Copied

Hi John,

I use Mac Pro 3Ghz 8-core Xeon E5 with 64GB. 

Everything works OK, with Rotobrush 1.0, but when I switch it to 2.0, the selection loses

Cheers,

Woytek

Likes

Translate

Translate

Report

Report
Community Guidelines
Be kind and respectful, give credit to the original source of content, and search for duplicates before posting. Learn more
Reply
Loading...
Jul 20, 2020 0
Community Beginner ,
Aug 12, 2020

Copy link to clipboard

Copied

Finally, this feature works for Mac Pro 2013!
I checked it out on version 17.1.4 (build 13 )

Cheers,

Wojtek 

Likes

Translate

Translate

Report

Report
Community Guidelines
Be kind and respectful, give credit to the original source of content, and search for duplicates before posting. Learn more
Reply
Loading...
Aug 12, 2020 0
Community Beginner ,
Jun 30, 2020

Copy link to clipboard

Copied

Must say I'm impressed so far. Big improvement over the first roto brush, that's for sure. Though, it still has difficulties with concave details which it tends to smooth a lot, like between nose and mouth on a profile shot. Using "Best" quality helps a bit for this matter, but it still could be improved. It also tends to include background elements too much to my taste during propagation, especially with straight elements like wall corners or grids. Like it propagates well for the first say 20 frames, and at 21 BAM! It decides to include something in the background out of nowhere. But again, a lot better than before, it is a huge time saver for the project I'm working on. Shots are still, but lighting is flickering and it handles that pretty well. It only happened two times on about 20 shots that when the light was flickering a bit too much, the refine edge brush strokes would get crazy.

Likes

Translate

Translate

Report

Report
Community Guidelines
Be kind and respectful, give credit to the original source of content, and search for duplicates before posting. Learn more
Reply
Loading...
Jun 30, 2020 1
Explorer ,
Aug 10, 2020

Copy link to clipboard

Copied

Hi,

This might be a temporary solution but try to get better edges using color correction methods.
After applying the masks just remove the color corrections and the masks should stay 🙂

 

(not sure if this still works but it used to).

Cheers

Likes

Translate

Translate

Report

Report
Community Guidelines
Be kind and respectful, give credit to the original source of content, and search for duplicates before posting. Learn more
Reply
Loading...
Aug 10, 2020 0
New Here ,
Aug 16, 2020

Copy link to clipboard

Copied

when ROTO BRUSH 2 WILL BE RELEASED OFFICIALLY 

Likes

Translate

Translate

Report

Report
Community Guidelines
Be kind and respectful, give credit to the original source of content, and search for duplicates before posting. Learn more
Reply
Loading...
Aug 16, 2020 0
Adobe Employee ,
Aug 17, 2020

Copy link to clipboard

Copied

Our new public beta program allows us to get feedback (including crash reports) from users to help us make that decision. So the answer is: when we have the evidence based on feedback that we’ve fixed all important bugs and the feature is working well in the real world.

Likes

Translate

Translate

Report

Report
Community Guidelines
Be kind and respectful, give credit to the original source of content, and search for duplicates before posting. Learn more
Reply
Loading...
Aug 17, 2020 1
New Here ,
Aug 18, 2020

Copy link to clipboard

Copied

We are not allowed to share footage but I did try rotobrush on various clips and while better it still wont cut it for our needs. If you think about red Carpet footage where celebrites are standing in front of busy backgrounds, people moving around in the background, lighting is poor, camera flashes going off, camera zooms. Really the worst conditions for rotoing. was hoping Roto 2 would be able to better handle these situations. 

Likes

Translate

Translate

Report

Report
Community Guidelines
Be kind and respectful, give credit to the original source of content, and search for duplicates before posting. Learn more
Reply
Loading...
Aug 18, 2020 0
Adobe Employee ,
Aug 18, 2020

Copy link to clipboard

Copied

Hi Janud, we’re always looking for ways to improve the segmentation results when using Roto Brush 2.  One way we do this is to "train" the machine learning models by feeding it problematic footage.  We'd very much like to analyze the footage you are referencing.  If you can get permission for us to only use the footage in-house for development use, then please send to rotobeta@adobe.com

Likes

Translate

Translate

Report

Report
Community Guidelines
Be kind and respectful, give credit to the original source of content, and search for duplicates before posting. Learn more
Reply
Loading...
Aug 18, 2020 0
New Here ,
Sep 03, 2020

Copy link to clipboard

Copied

I've tried the rotobrush 2 in the beta version of AE, but it simply does not work! Everytime I get an error: After Effects (beta) warning unknown

Likes

Translate

Translate

Report

Report
Community Guidelines
Be kind and respectful, give credit to the original source of content, and search for duplicates before posting. Learn more
Reply
Loading...
Sep 03, 2020 0
Adobe Employee ,
Sep 03, 2020

Copy link to clipboard

Copied

It's working again, in build 17.5x010.  Follow this forum thread for deails as we update the post:

https://community.adobe.com/t5/after-effects-beta/rotobrush-2-no-longer-working/td-p/11403445?page=1

Thanks.

Likes

Translate

Translate

Report

Report
Community Guidelines
Be kind and respectful, give credit to the original source of content, and search for duplicates before posting. Learn more
Reply
Loading...
Sep 03, 2020 0