After Effects Lip Sync Auto-Detection

Question

It’s been years since I have tried to use Character Animator to auto-detect lip sync for After Effects cartoon characters. I wasn’t happy with the results.

I have been using a .MOV file with time remapping and keyframes, where I scrub through the timeline audio and I set keyframes for the phonemes. The MOV file has a frame for each mouth, I scrub, I keyframe.

Right now I am making a project where most of the characters only have four different mouths for pretty much all of the sounds. Has anyone managed to build a better mousetrap for auto-detecting phonemes, are am I still resigned to scrubbing & keyframing?

Thanks.

Warren Heaton · Accepted Answer

You’re doing it the way it’s been done since… er… After Effects 1.0.

This might be something to try with the new Ai Assistant in After Effects Beta.

I’m not sure if it would do everything, but maybe something along the lines of matching keyframe label colors to marker label colors to speed up the process.

Kevin-Monahan · Answer

Hi there.Since you're looking for an automated lip-sync workflow and have already worked with Character Animator, I think the Character Animator forum may be a better place to get advice from people with deeper experience with its lip-sync tools.Would you like me to move this post over there for you? Let me know.Thanks,Kevin

Sign up

To post, reply, or follow discussions, please sign in with your Adobe ID.

Sign in to Adobe Community

To post, reply, or follow discussions, please sign in with your Adobe ID.