Skip to main content
New Participant
January 29, 2018
Answered

Pen Tool not creating Masks correctly

  • January 29, 2018
  • 6 replies
  • 14385 views

I'm seeing a strange issue where I try to draw a layer mask with the pen tool, and instead of adding a path point where my mouse is, the new point is on top of the first one, and it's given handles that reach where the mouse is.  I have a layer selected, I definitely know how to use the pen tool, and I can create shape layers just fine. The issue is drawing a mask on an image layer.  I can use the polygon tool and make a square, and add and move points, to get the desired mask but that's just an awful solution.  This problem has occurred over many projects, and I've restarted my computer and the application several times.  I just updated AE as well.

I have no idea why it's acting crazy or really even what's happening and would LOVE some assistance.(the cursor wasn't captured but it was above the first letter on the right, where the handle is)

    Correct answer Rick Gerard

    I am assuming that your OS and AE version are up to date and nothing changed between the working mode and the problem mode except something in your comp.

    Try adding a new comp with only a new solid. If it does not work follow the reboot, relaunch and try again in a new project with nothing but a solid in the comp. If that works, the problem is probably solved, if not try trashing preferences. If the problem still exists then check your mouse drivers, GPU and everything else.

    If the new comp new solid works but you are still having problems with the problem comp then reveal all modified properties of all layers in the comp and start turning things off until you find the culprit.

    6 replies

    New Participant
    July 10, 2025

    Can confirm this bug is alive and well. Things not causing the issue:

     

    Shape layers

    Large layers

    small layers

    mp4 files

    mov files

    Ai files

    tabelt

     

    Bottom line: what appears to be happening is a confirmed bug is ignoring pointer coordinates and when the mouse button is pressed (or pen or trackball) a new vertex is added directly on top on the initial vertex. If you know how many vertices you need and simply count mouse clicks, you can then go back to the "vertex stack and move the vertices one at a time to their proper places on the layer. Then, for no real reason, you can select the last (sequential) vertex and double click the first (sequentially) vertex and close the loop in the normal fashion. 

     

    I have been drawing masks using the pen tool all day. And on the next to last Ae project in my production pipeline, this bug popped up and it has persisted ever since.

     

    I've reset everything - and I mean EVERYTHING - rebooted, restarted and even created a fresh, new animation. All to no avail. The pen tool for mask creation seems to be dead to me for now.

    New Participant
    July 10, 2025

    *tablet

    nishu_kush
    Community Manager
    Community Manager
    July 10, 2025

    We can get this checked. What version of After Effects are you using? Are you on macOS or Windows? Can you share a screen recording of the issue? I just tested it on my end in the latest version of After Effects, and the pen tool seems to be working fine.

    Looking forward to your response.


    Thanks,
    Nishu

    Participating Frequently
    April 26, 2022

    Just had this problem today for the first time in 7 yrs of AE experience.

     

    My setup:

    Comp layer with animation applied to scale property.

    Mask on the layer, mask edit mode active in composition panel, selection tool in use.

    Click and drag with the mouse

     

    Expected Behavior:

    Maquee selection resulting in newly selected mask vertices

     

    Actual Behavior:

    Mask edges or corners nearest my cursor are automatically selected and dragged

     

    Very suboptimal workaround:

    Delete scale keyframes and replace them AFTER adjusting my mask.

    Participating Frequently
    July 21, 2022

    Another day, another unacceptable bug from Adobe. I just started having this issue for the first time as well, of course on an important project with a tight deadline. The crazy thing is at this point, EVERY single day that I work in After Effects I encounter a brand new bug that brings my day to a grinding hault, often times several times a day. I can't believe software this popular and crucial to so many people is so unusable at this point. And it continues to get worse and worse and worse. I must be at risk for being the community ranter at this point, but this is seriously so unacceptable and so uncessesarily stressful!!

    Participating Frequently
    July 21, 2022

    just to add something slightly constructive, I can confirm that in my experience with this pen tool issue my large video layers are scaled down to 2% and are parented to a null for tracking purposes, so it checks out that this bug is related to using the pen tool on layers that are scaled to small sizes. But along the lines of what OP mentioned, this is pretty damn normal for professional compositing when you're working with 2k 4k 8k etc files in a 1080 comp. 

    Adobe needs to start making tutorials on learning how to deal with all their bugs, because they never get fixed and at this point, knowing their software is 80% bug workarounds and 20% interface usability.

    charleh
    Participating Frequently
    March 2, 2022

    Just had this issue as well, used the same fix as others (remove animation apply mask, reapply animation). This should be fixed!

    maikm92830163
    New Participant
    June 14, 2021

    Hello, I had this problem today, it seem I was trying to mask a layer that already has an animation (scale in my case), and the pen tool was doing the same that you describe here, so my solution was to delete de animation, then mask and then, animate again.

    JJ Umana
    New Participant
    June 16, 2021

    Just had this bug with the latest update... and deleting the animation lets me draw the mask with no problem.

    rosieposy
    Participating Frequently
    January 18, 2021

    Hi. I know this thread is old but thought I'd put this here in case it helps anybody. My set-up is not the same as in the original post but I've been having the same issue. It has turned out to be specifically due to scaling. The layer on which I'm drawing the path is parented to a null that scales everything for an animated zoom-out. I hadn't realised that this has resulted in the path layer being scaled down to only two percent. I think this means that, although the vector points look far apart to me when I'm zoomed in, they're actually very close. The pen tool behaves normally when I first create the layer but it starts behaving oddly after a while, even after trying all the usual fixes and two different versions of AE. My workaround is just to draw the points further out and drag them into place. Not ideal but I'm getting through it and will avoid ever being in this position again!

    New Participant
    February 9, 2021

    Hi. 
    I'm also having the same issue, and have had it intermittenly on verious projects. 

    Thank Rosieposy for the tip about scaling. Mine was a little different however. I unparented the layer from the null I had it parented too but that didn't work. I also had some scale keyframes on the layer to be masked. The only way I got the pen tool to work normally is by deleting the scale keyframes... not ideal at all. 
    The best work around I found was to cut the scale keyframes, then drow the mask, and then paste the scale keyframes back in. 

    I wish Adobe would fix this, I've been having this issue on and off since Ae 16 and on. 

    Rick GerardCorrect answer
    Adobe Expert
    January 29, 2018

    I am assuming that your OS and AE version are up to date and nothing changed between the working mode and the problem mode except something in your comp.

    Try adding a new comp with only a new solid. If it does not work follow the reboot, relaunch and try again in a new project with nothing but a solid in the comp. If that works, the problem is probably solved, if not try trashing preferences. If the problem still exists then check your mouse drivers, GPU and everything else.

    If the new comp new solid works but you are still having problems with the problem comp then reveal all modified properties of all layers in the comp and start turning things off until you find the culprit.

    kspangenAuthor
    New Participant
    January 29, 2018

    Thanks Rick. This is across multiple comps/projects. It seems to be only on image layers, my video layer masking is ok.  I'll try dumping my preferences.  I can double-click the layer and edit the mask just fine in the layer panel, so there's something weird going on in the comp panel

    Adobe Expert
    January 29, 2018

    just for fun, you might want to try toggling the pen tool to rotobezier and see if that works. Anything common about the image files that are giving you problems?