Skip to main content
RockyDavies
Known Participant
Aug 4, 2017 7:37 PM UTC
Answered

How do I use a variety of mouth sets while computing lip sync from scene audio?

Okay!  So, I recorded a couple different audio tracks for my various puppets in Audition.  Now I have imported them into Ch and I want to apply them to the puppets.  I can do this - but - it lip syncs the whole thing to the default mouth set.  I want to be able to show a variety of emotions though.  I have other mouth sets present and rigged for angry, worried, etc.  How do I trigger them and also sync to the existing audio file?  I want it to sync and to be able to tell it when to switch to my angry mouths, worried mouths, etc.

Do I have to chop up the audio file for each emotion or something?  How do I tell Ch which mouth set to use when syncing?  If there is an easy way to keytrigger the syncing, that would be awesome.

Any help?

This topic is closed to new replies. Start a new post to keep the conversation going.
oksamurai
oksamuraiCorrect answer
Legend
Aug 7, 2017 5:19 PM UTC

If it's set up correctly (like Character Animator Tips & Tricks (September 2016) - YouTube ), then it should just work. Bring in the audio track, compute lip sync from scene audio, then disarm everything except keyboard triggers. Do a recording pass with just that and trigger at the right times - and the lip sync should carry through to the other mouths.

11 replies

RockyDavies
Known Participant
Aug 9, 2017 11:15 PM UTC

Here's a test clip for doing the expressions and everything together.  I'll chop it up and use it in the final animation.

Translate
oksamurai
Legend
Aug 10, 2017 4:54 PM UTC

Looking awesome!

Translate
RockyDavies
Known Participant
Aug 9, 2017 9:26 PM UTC

My super high tech way of directing myself where and when to hit what keyboard triggers, haha. Post-it to the rescue. Yeah, I hope in future iterations, you can easily see and edit when you trigger what key and add, delete, chop, or extend the trigger events instead of catching them on the fly.

I think the decreased recording speed should help too.

Translate
RockyDavies
Known Participant
Aug 7, 2017 9:35 PM UTC

Okay, I have another question on here that hopefully gets through even though I marked the question answered.  I got the different mouths and emotions to work with the "compute lip sync" thing, but I have a new need/question.  I have a handful of emotions and I want to be able to fine tune where they come in at and how long they last.  In the screenshot, you can see the "keyboard triggers A, C, W."  I tried shrinking the length of the keys and moving their boxes around (like you can see there) but that didn't really seem to do anything.

So can I do the key triggers manually in the timeline and tweak them instead of recording them live on the fly?

Translate
El Wombat
Inspiring
Aug 8, 2017 11:29 AM UTC

Hi Rocky,

I had a similar task at hand the other day and I think:

a) Yes, you can, but…

b) it's a bit tricky because the bars show only that there is activity for that specific trigger, not which: on or off.

I think a possible workaround is to set the default position to another trigger (normally, you don't do that for "default" layers or groups…) and that way you would be able to just turn "on" with a key, then another with a different key "on" that overrides the former, and so on. And with bars that show only one kind of activity you can then finetune.

I *think* that was how I solved my similar issue… Hope this helps.

Translate
RockyDavies
Known Participant
Aug 8, 2017 5:25 PM UTC

Thanks El Wombat for the suggestion, I'll see if that helps!

Translate
oksamurai
oksamuraiCorrect answer
Legend
Aug 7, 2017 5:19 PM UTC

If it's set up correctly (like Character Animator Tips & Tricks (September 2016) - YouTube ), then it should just work. Bring in the audio track, compute lip sync from scene audio, then disarm everything except keyboard triggers. Do a recording pass with just that and trigger at the right times - and the lip sync should carry through to the other mouths.

Translate
RockyDavies
Known Participant
Aug 7, 2017 8:01 PM UTC

Okay awesome!  I knew it was probably something simple like that.  I just needed the part to disarm everything else except the keyboard triggers, I think I had been trying to keep lip sync on along with lip sync "keyboard input" thinking that was it.  Your way worked like a charm!  Thanks again.

Translate