Skip to main content
November 14, 2016
Question

Visemes Sound Like This...

  • November 14, 2016
  • 1 reply
  • 2890 views

This might sound strange, but how do these sound?

Could someone record the sound of each, or write some words to demonstrate the individual sounds... please?

    This topic has been closed for replies.

    1 reply

    El Wombat
    Inspiring
    November 14, 2016

    I rally to your question for I'm not 100% sure but what I gathered so far is this:

    "Ah" is "A/E" like in "Acid" or "Erroll",

    "Uh" is "A" like in "Albany" or "Under".

    "Ee" is "ee" like in "England" or "Eagle".

    "W-Oo" is "W/(j)U" as in "Woody" or "United"

    "Oh" is just that.

    The thumbnail images give a good indication of what's meant with each viseme.

    It also helps to talk with your puppet in a slow and extra clear way "That. You. Would. Normally. Use. For. Deaf. People. Or. Tourists".

    The consonants are pretty much those consonants, only you want to keep in mind that "K" is dealt with by "S", "Th" by the "L", see here:

    New features summary for the November 2016 release of Adobe Character Animator CC (Beta)

    Improved lip sync and new/revised visemes

    Lip sync accuracy has been improved again in this build. Also, the number of visemes has increased from 10 to 11, but with several changes:

    • “R” added
    • “Th” merged with the existing “L”
    • “Oh–Uh” split into “Oh” and “Uh”
    • “K” renamed as “S”

    Existing artwork using “Th” and “K” layers get the new tags, and “Oh–Uh” layers get the“Oh” tag.

    November 14, 2016

    Hi Wombat!

    First.. you made me laugh when you mention talking slow to Tourist and the Deaf.... I thought it was only the English that did that! Believe me... Deaf people don't talk slow!

    Thanks for your input... The Visemes that Ch uses obviously represent several phonemes per Viseme... and are cartoon based, not for real speech. Often the viseme will work for the beginning of a word.. so the mouth changes shape as you say the whole word, but I can see that it would be a big ask to get all the appropriate phonemes for every word spoken. The Visemes work well, but I just wanted to get an understanding of how they are formed, so thanks again  for your input and link!

    El Wombat
    Inspiring
    November 14, 2016

    Hi finnandme,

    glad you found it useful!

    Sorry if I didn't put it too well, but I definitely didn't mean to say that deaf (or hard of hearing) people talk slow at all, only that when someone doesn't know how to speak sign language it can help to speak slower and clearer to them which also applies to tourists who don't know the local language too well…

    It helps also to find out about the visemes and how they work. But no matter how much you practise, I think it is impossible to avoid "jumps" or inappropriate combinations that you mention - they are due to the fact that Character Animator cannot possibly know what will come after this or that viseme or sound. 

    That's why I strongly believe that the Nutcracker Jaw behaviour will give the most harmonic results in the future if Adobe manage to track the mouth more accurately than now.

    Ideally, the software would have trackers for the upper lip and lower lip and then simply follow the movements of my mouth and jaw instead of trying to hear and analyze what I may be mumbling. Talking about mumbles: The Audio Lip Sync is relatively "immune" to variation in amplitude, although you can set mouth sensitivity up in the project panel, under "FACE"-->"Mouth Sensitivity".

    Further you can fine-tune whatever you have been recording by going to

    TIMELINE-->Split Lip Sync into Visemes

    See here:

    Manually modify visemes after split lip sync in visemes?