Skip to main content
New Participant
July 6, 2020
Question

Lip syncing only recognizes a few mouths

  • July 6, 2020
  • 3 replies
  • 417 views

When in Record, I only see the puppet's mouth change to a number of mouths.  Neutral, smile, and surprised are the only mouths shown when I'm recording my face and I'm not sure why.  Any ideas as to why this is happening?  Thanks!  If you need any more information please let me know.  I love this program and hope to improve my puppet

This topic has been closed for replies.

3 replies

alank99101739
Brainiac
July 6, 2020

Could you show a screen shot of the timeline panel showing the visemes it picked for saying something with lots of different sounds? (The quick brown fox jumped over the lazy dog, or something like that.) I don't know how to fiddle the settings sorry beyond the obvious, but it is definitely not perfect. Seeing a waveform of an audio recording alongside the visemes it picked might help identify whether "that is as good as it gets" or not. (Note: you can edit the visemes afterwards if recording, but live performances that is not an option, and its time consuming.)

New Participant
July 6, 2020

I'd like to do live performances with this so trying to get the best results.  Here is the timeline for the phrase you recommended.  

 

I did notice that before saying anything, the mouth started to change.  Not sure what triggered this.  I turned off everything around my mic that could have caused some sound aside my own voice and the mouth was still changing for some reason.

 

Also noticed this lip-sync option.  Not sure if adjusting it will help with getting the best result.

alank99101739
Brainiac
July 6, 2020

Neutral is the default. Smile and Surprised come from the webcam and face behavior. The rest come from audio processing and the lipsync behavior. If audio quality is low, then it will do a less good job. 

New Participant
July 6, 2020

Is there anyway to improve my audio quality?  I have a mic connected and I'm speaking directly into it, but the lip-sync is still off a bit.  My mic is not too old so I dont think its the mic itself. 

 

 

New Participant
July 6, 2020

UPDATE

After recording a bit, I do see a few of the different mouths but its not as fluid as I'd like it to be.  The puppet's mouth doesn't seem to match what I'm saying in the camera view.  Any help with this?