Skip to main content
Participant
November 20, 2016
Question

Feature request: improving the lip Sync (override mode)

Hello!

I am an animation professional, currently working on Disney productions. I just recently purchased a cloud license, and the main reason for it was to fiddle with Character Animator. Long story short, I LOVE IT.

Once thing that  I found could be improved is the Lip Sync control . While the audio analysis is far superior to anything I have seen before (Toon Boom, Flash plugins, Crazy talk..)  like any automated process, it could greatly benefit from the animator's input.

I tried to do this currently and found the way we can edit those phonemes is impractical. We need to play the audio and press the different keys at the exact time, for the exact duration of each phoneme. It would require several takes to get it just right.

Instead, I would like to propose this solution, which wouldn't require much code. Lipsync OVERRIDE MODE

Once selected, the timeline would display which phoneme is activated in each viseme (the information is already there, it would simply display it visually), and simply by selecting it and hitting the Key of the desired Phoneme, EX, "F" you would override  the phoneme displayed for the exact duration  the audio analysis set.

If that wouldn't be accurate, we could use our current means to adjust that.

Splitting phonemes to add more info with the razor tool could be a great addition too. It's currently easy to adjust the duration of the phonemes, but not to change them or add new ones.

I'm looking forward to work with you in improving this amazing new system.

Ce sujet a été fermé aux réponses.

1 commentaire

oksamurai
Legend
November 21, 2016

Haha, you must be a mind reader because we are working on something very similar right now. We agree - what we have now was a "what's the quickest way we can get lip sync editing into the app" solution, not the best. What's coming next should do exactly what you want - and maybe even a little more!

Thanks for the input, much appreciated!

jaanusm72591254
Participant
January 27, 2017

That is awesome to hear. For some reason if I use my laptop mic, the lips sync pretty well, but if I use more professional recording equipment and some processing, lip syncing goes pretty bad. I was personally imagining something similar to the "frame picker" option or Keyframe Caddy addon in Animate CC, but this solution here might be even better.