Skip to main content
TinyTim2046
TinyTim2046
Participating Frequently
July 31, 2018
Answered

Character doesn't follow my movements

  • July 31, 2018
  • 2 replies
  • 731 views

Hello, everyone.

So, I'm trying to learn the Character Animator by building characters and, so far, they don't match my movements very well. The eyes don't match my eye movements half the time and the mouth doesn't match the sounds I'm making most of the time. I usually practice this in a quiet area, so there's not other noise to interfere with the audio intake and I try to have my face well-lit, so I don't see why the camera isn't able to follow me. What can I do?

Thank you.

This topic has been closed for replies.
Correct answer alank99101739

For eye gaze, are you using the web cam? I find it useful, but not that accurate. Eye gaze has "snap eye gaze" which locks the eyes to 9 positions (up down left right and combinations thereof). This stops eye jitter. If you turn this off, I recommend disabling camera input under Eye Gaze and use the mouse/touch input instead. You get much better control over the eyes that way. (This is personal opinion - but I have had times I am looking directly at the screen and the eyes bound around a bit - not a lot, but enough to feel uncomfortable watching it.)

Mouth positions (from the Face behavior) are controlled by sound, except for smile and surprise (they are from the web cam). So a well lit face for "lipsync" probably won't help. I would make sure the recording level is high enough etc. One way to test this is to do a recording and see how high the waveform is. I typically use Adobe Audition instead of recording inside Character Animator, because it has a "Normalize" effect to normalize the amplitude (makes it louder if needed). I then load that sound file into Character Animator and use "Compute Lipsync from Scene Audio" in the menus. The other thing you can do (for testing) is after recording a dummy lipsync, you can right click in the timeline and add your own visemes by hand. Its tedious and boring, but you can then make sure the mouth positions work correctly. If adding by hand looks good, then I would guess microphone volume problems as the most likely cause of sub-standard results.

But the tools are not perfect. Good, but not perfect. They do play up at times.

2 replies

SharonfromMD
SharonfromMD
Inspiring
July 31, 2018

One of the things I've heard is that lighting on your face makes a big difference. In other words, make sure you are in a bright room.

I write animated children's songs, and personally I prefer to use triggers with facial expressions and the import lip sync more than actually input.  Good luck.

    alank99101739
    alank99101739Correct answer
    Legend
    July 31, 2018

    For eye gaze, are you using the web cam? I find it useful, but not that accurate. Eye gaze has "snap eye gaze" which locks the eyes to 9 positions (up down left right and combinations thereof). This stops eye jitter. If you turn this off, I recommend disabling camera input under Eye Gaze and use the mouse/touch input instead. You get much better control over the eyes that way. (This is personal opinion - but I have had times I am looking directly at the screen and the eyes bound around a bit - not a lot, but enough to feel uncomfortable watching it.)

    Mouth positions (from the Face behavior) are controlled by sound, except for smile and surprise (they are from the web cam). So a well lit face for "lipsync" probably won't help. I would make sure the recording level is high enough etc. One way to test this is to do a recording and see how high the waveform is. I typically use Adobe Audition instead of recording inside Character Animator, because it has a "Normalize" effect to normalize the amplitude (makes it louder if needed). I then load that sound file into Character Animator and use "Compute Lipsync from Scene Audio" in the menus. The other thing you can do (for testing) is after recording a dummy lipsync, you can right click in the timeline and add your own visemes by hand. Its tedious and boring, but you can then make sure the mouth positions work correctly. If adding by hand looks good, then I would guess microphone volume problems as the most likely cause of sub-standard results.

    But the tools are not perfect. Good, but not perfect. They do play up at times.

      Terms & ConditionsAccessibility statement
      Using the community Terms of use Privacy Cookie preferences Do not sell or share my personal information ad choicesAdChoices