Skip to main content
Participating Frequently
January 25, 2023
Question

Does webcam lip sync work without audio input?

  • January 25, 2023
  • 1 reply
  • 246 views

Hi everyone, 

 

I've noticed that my lip sync only works if the audio input is enabled. If I open my mouth without saying a sound, I can see the markers tracking my face/mouth, but nothing corresponds on the character's mouth. However, when I close my eyes or tilt my head, the character does. I'm just not getting any lip movement. 

 

Has anyone encountered this problem?

 

Thank you!

This topic has been closed for replies.

1 reply

Erica Schisler
Inspiring
January 25, 2023

You are correct. Lip Sync works primarily with audio. 

There are three shapes that are determined by the shape of your mouth in the webcam. These only show up if no audio is detected (no one is talking): Neutral, Smile, and Surprised. Neutral is the most common to see, and it is suggested that this should be your default “rest” mouth.

The other 11 suggested mouth shapes, called visemes, are determined by audio. Visemes

are visualizations of key mouth positions when saying common phonetic sounds. Character Animator listens for 60+ specific sounds and translates them into visemes.

The face tracking you're seeing is for your head and eyes but it is not for lip sync. 

dkrissmanAuthor
Participating Frequently
January 25, 2023

Erica, thank you so much for the info and quick reply. So very much appreciate it. 🙂