Skip to main content
Inspiring
July 14, 2020
Question

Full body characters will not copy mouth shape from camera.

  • July 14, 2020
  • 2 replies
  • 246 views

Hi all,

 

I'm VERY new to Character Animator, so I apologize if this is a pretty stupid quiestion.

 

I'm really not sure what the issue is, and can't seem to find a solution for this specific issue.  When I use any full body rig provided by CA (e.g. Blank), and activate my camera, it will copy my head movement, eyes, and eyebrows, but not my mouth movement.  It will continually stay in it's neutral position.

 

When I enable the mic, it pics up the ambient noise from the room, and automatically does the "ee" mouth shape.  When I start talking, it will copy what I say, and go back to the "ee" shape when the talking has stopped.  The same happens whenever I use a seperate mic from the camera.

 

What's strange is how this does not happen if I use a character that is only the head (e.g. Chad).  I am running CA in Windows 10.

 

Does anyone know how I can make the character copy my mouth shapes for full body characters?

 

 

This topic has been closed for replies.

2 replies

alank99101739
Legend
July 14, 2020

Ok, let's start with Smile and Surprised then. See if we can get them going. I am going to start with obvious things that I think are probably fine since it works with some puppets, but good to be sure! 😉

 

First thing, I assume you have the webcam on and can see your face up in the top right corner?

 

Next, if you look closely at your picture, after you have your face in the panel for a bit, do you see little red dots on your face? If so, that means it has recognized your face and is tracking it.

 

I think those two will be fine since it works on some puppets. So then open the puppet up in rig mode (I double click on puppet in project panel). Then select the root of the puppet and have a look for the Face behavior in the Properties panel to the right.

 

In the Face behavior, expand the "Handles" and "Replacements" sections. There should be a little ">" character to click on to expand. We want to make sure Handles has found "Head" and "Mouth" in particular. You can expand those sections to see the layer it the puppet they found and bound to. If they did not bind to something, that is a problem.

 

Next, expand the Replacements section and look for "Mouths". Under it I have "Mouth Group", "Neutral", "Smile", and "Surprised". I never worked out what Mouth Group was to be honest, but Smile and Surprised I wanted to make sure were bound to something. If not, that is a problem.

 

Finally, make a recording with the Face behavior armed. Make some expressions on the face to make a recording then stop. Try playing it back. Do expressions work then?

 

The above was to try and track down which step of the puppet has the problem. I very much doubt its full body vs head only - it is more likely to be something about the structure and tagging in the puppet. Hopefully the above will give some more evidence. Oh, a screenshot of the rigging panel of the puppet (expanding the mouth laters) could be useful too - so I can see the puppet hierarchy for one that is not working.

alank99101739
Legend
July 14, 2020

The camera controls two mouth positions - smile and surprised. The rest of the mouth positions are triggered by audio processing. It listens to the microphone doing its best guess of the sound and what letter is being said, then it picks the viseme based on that.

 

I am wondering if the "ee" mouth shape is actually a smile. Try doing a "reset pose" button near the camera. It might have picked a default face position that was not a good nueutral pose. So when you stop talking the web cam is guessing you are smiling. Reset post will hopefully help if that is the case.

Inspiring
July 14, 2020

Thank you for the reply -No matter what expression I do into the camera (even triggered expressions like smiles and surprise), it does not change and stays at the neutral faceial expression.

 

I do set the "Reset Pose", and it will be fine in that moment.  The "ee" seems to be from the ambient noise.  And this only seems to be for the full bodied characters, not characters that are only heads (like Chad).