Skip to main content
Ethereal_world250b
Participant
September 17, 2026
Answered

How to sync real life stopmotion puppet to automate lip syncing

  • September 17, 2026
  • 3 replies
  • 30 views

So, I have built a real life set, alongside a simple clay bird puppet. I have taken a variety of photos, that follow this categorization:

 

sitting still mouth closed, sitting still mouth half open, sitting still mouth fully open

left hand raised mouth closed, left hand raised mouth half open, left hand raised mouth fully open

leaning in mouth closed, leaning in mouth half open, leaning in mouth fully open

 

These images would be used for lip syncing, and doing it manually is an extremely tedious process.

I have been attempting to import these images into character creator, and use keybinds to switch into those previously mentioned poses, while letting the auto-lip syncer handle the rest, but i have been having immense trouble. 

 

I am at the point where my puppet is moving in playback, but it is not doing any mouth movements. 

I really am not going to go step by step of everything I did, this is a hail mary to induce further conversation to potentially find the issue. 

    Correct answer TheOriginalGC

    Well, what you want to do is possible, though you’re going to have your work cut out for you because you’re going to have to essentially go against how Character Animator is set up to function. However, Character Animator is currently the only program (that I know of) that will allow you to synchronize audio with mouth movements in real time. If your goal does not require you to have the animation to synchronize with the audio as you speak, you might want to look at using Adobe Animate to synchronize your character’s mouth motions with a recorded audio track as shown here: Adobe Learn - Learn Animate - Animate characters with Auto Lip-Sync

    To get Character Animator to do what you want it to do, you’ll need to employ a couple of techniques. The first is SWAP SETS. A swap set is a folder with all of the alternatives for a part (hand, head, etc.) in a single folder. For instance, you might have an ARM folder with the arm up and down (a swap set can have more than two states, but I’m using up and down for this example). In the program, this folder becomes a sort of placeholder for that part and you will be telling the program to switch between the various images within that folder - it will only ever show one of the available alternative images at a time, so you need to make sure that everything you want to display in an instance is included in that alternate layer. Then you assign a trigger to the swap set, for instance using the letter “U” on the keyboard to switch between arm up and arm down, much like a light switch turns lights on and off.

    Another behavior that you will need to implement is CYCLE LAYERS, which tells the program to display a sequence of images, one at a time, in the specified order. Think of it as a way to add “tweens” to what you’re doing in the program.

    This link explains a bit about both SWAP SETS and CYCLE LAYERS: Behaviors: layer swapping | Character Animator

    I can go into greater detail, but I want to make sure I understand which path you want to go down.

    3 replies

    TheOriginalGC
    Community Expert
    TheOriginalGCCommunity ExpertCorrect answer
    Community Expert
    September 18, 2026

    Well, what you want to do is possible, though you’re going to have your work cut out for you because you’re going to have to essentially go against how Character Animator is set up to function. However, Character Animator is currently the only program (that I know of) that will allow you to synchronize audio with mouth movements in real time. If your goal does not require you to have the animation to synchronize with the audio as you speak, you might want to look at using Adobe Animate to synchronize your character’s mouth motions with a recorded audio track as shown here: Adobe Learn - Learn Animate - Animate characters with Auto Lip-Sync

    To get Character Animator to do what you want it to do, you’ll need to employ a couple of techniques. The first is SWAP SETS. A swap set is a folder with all of the alternatives for a part (hand, head, etc.) in a single folder. For instance, you might have an ARM folder with the arm up and down (a swap set can have more than two states, but I’m using up and down for this example). In the program, this folder becomes a sort of placeholder for that part and you will be telling the program to switch between the various images within that folder - it will only ever show one of the available alternative images at a time, so you need to make sure that everything you want to display in an instance is included in that alternate layer. Then you assign a trigger to the swap set, for instance using the letter “U” on the keyboard to switch between arm up and arm down, much like a light switch turns lights on and off.

    Another behavior that you will need to implement is CYCLE LAYERS, which tells the program to display a sequence of images, one at a time, in the specified order. Think of it as a way to add “tweens” to what you’re doing in the program.

    This link explains a bit about both SWAP SETS and CYCLE LAYERS: Behaviors: layer swapping | Character Animator

    I can go into greater detail, but I want to make sure I understand which path you want to go down.

    TheOriginalGC
    Community Expert
    TheOriginalGCCommunity Expert
    Community Expert
    September 17, 2026

    To work with Character Animator, everything has to:

    (A) Be 2 dimensional, and

    (B) In precisely the format that the program can recognize.

    It sounds like you’ve got the first part under control by turning the clay model into a series of flat images.

    To get to the second part, the character needs to be set up in a series of layers (either in Photoshop or Adobe Illustrator) and each part needs to be tagged so that both you and the program are referring to the same thing when setting up your animation.

    I know that you do not want to go step by step through everything you did, but you will still need to help us to understand how you currently have this set up.

    When you say, “categorization,” do you mean that you have 7 images? Are any of the parts separated (for instance, is the left hand on a separate layer from the rest of the body)? Is “character creator” a specific utility that you are using or am I correct in assuming that you meant to say “Character Animator?”

    I’m not trying to be difficult here, but just as you need to communicate with the program to get the results that you need, we also need to be on the same page when communicating with each other. 

    To put it simply, in order for lip syncing to work properly, the character needs to be separated into individual parts, specifically a head with a mouth as an independent part with in it. Similarly, that mouth will need to be further sub-divided, at the very least into alternating frames that can be triggered by audio, or (ideally) all of the different mouth shapes commonly used in speech. 

     

     

    Ethereal_world250bAuthor
    Participant
    September 17, 2026

    Hello, thank you for the response. To understand clearly on what I am intending to do, I will elaborate

    So, I am a stop motion animator, and I have created a real life puppet alongside a set to go with it.

     

    I have taken a series of photos of the puppet to use to lip sync (when i say lip sync, I really just mean “the mouth opens when I speak,” very nutcracker-esque) with my vocals. To do this, I have taken 3 images: one of the puppet sitting still, with the mouth closed, one in the exact some position but with the mouth slightly open, and one in the same position but with the mouth fully open. I have manually done this before (closed when not speaking, half open when speaking quietly, fully open for the “ahs” and “ohs,”) but it is an extremely tedious process. 

     

    My goal with Adobe Character Animator (i mistakenly refered to it as character creator in my last post) is for it to do this automatically. Simply put, i want the program to display the closed mouth image when i am not saying anything (or pronouncing my “mms,”) and display the two (half and fully) open mouth images when i am speaking. This is the bare bones of what I want to do, now the part where it gets difficult is i want to repeat this process for 5 other poses, looking something like this:

     

    Sitting idle mouth closed, sitting idle mouth half open, sitting idle mouth fully open

    left arm raised mouth closed, left arm raised mouth half open, left arm raised mouth fully open

    leaning in mouth closed, leaning in mouth half open, leaning in mouth fully open

     

    I want to switch between this poses while maintaining the status of the mouth, for example if i were to be screaming, i would want to switch from the idle sitting mouth fully open photo into the leaning in mouth fully open photo, and when I stop the two images shown in succession would be the leaning in mouth half closed, and then leaning in mouth closed. 

     

    Now, to elaborate on the exact kind of photos: i do not want to make a traditional puppet, like those pre-made 2d puppets in the adobe creator with the face tracking and warping abilities, I simply want to maintain the stop-motion animation style by switching between those poses and mouth frames within those poses. 

     

    If it were possible to do this with body tracking (ie when I raise my left and and speak quietly, the puppet in the program shifts to the “left hand raised mouth half open” photo) then I would like to hear how I would go about that, but right now I am wanting to do this with triggers or swap sets (no idea how the program works, not sure which of these I am about to describe) 

    where if i insert an audio clip, the program syncs it nutcracker-style, and i can press a key to switch the poses, while the program takes care of the lip sync.

     

    As of right now in Photoshop, I have done the following:

     

    -The background set image (no puppet)

     

       -Folder Group named “Rest” (mouth closed poses)

    • rest idle sitting
    • rest left arm raised
    • rest both arms raised
    • rest both arms more raised
    • rest head turned left

    -Folder group names “Ee” (mouth half closed poses)

    • ee idle sitting
    • ee left arm raised
    • ee both arms raised
    • ee both arms more raised
    • ee head turned left

    -Folder group names “Ah” (mouth fully opened)

    • ah idle sitting
    • ah left arm raised
    • ah both arms raised
    • ah both arms more raised
    • ah head turned left

    Now, the background image is a full image, while the pose images are PNGs, so it looks like the puppet is The Vitruvian Man. 

     

    I do not know what to do in Character Animator, so let me know what to do there if you can, if you would like to see my faulty setup then let me know what you need to see and ill send images.

     

    By the way, if you want to see just what exactly it is im attempting to do, you can see my manual lip sync on my youtube channel “TheMendoShow,” its the grey anthro bird one.

     

    Thank you for helping, and let me know what other info you need.

     

     

     

    Terms & ConditionsAccessibility statement
    Using the community Terms of use Privacy Cookie preferences Do not sell or share my personal information ad choicesAdChoices