Skip to main content
Participant
June 23, 2021
Question

Show different layer sequences based on audio input (either randomly or when specific sounds heard)

  • June 23, 2021
  • 2 replies
  • 424 views

I want my character's talking experience to be more natural without having to trigger keys manually. While talking, when my character detects a sound (like "Oh", "Aa"), in addition to the regular lip sync I also want it to move it's hands (ideally with randomized hand movement animations, otherwise a different hand motion / animation for "Oh", "Aa", etc would also be fine).

 

I looked into Layer Picker and got through creating a cycle animation triggered by audio input. I went through this https://community.adobe.com/t5/character-animator/layer-picker-or-cycle-layers-via-audio-input/m-p/10182546 and also this video starting here https://www.youtube.com/watch?v=vVKmDLsnsiI&t=1290s I got these basic examples working and it's a step in the right direction, but I'm not there yet.

As far as audio input, I dont care about loudness of the audio, I need to either show different sequences of layers

1. randomly based on any audio input being detected (loudness not being important), or

2. specific replays when specific sounds (lip sync) are uttered.

 

I'm hoping someone can point me to a way to accomplish this. It could use either the Layer Picker behavior, cycle layers, a combination, or something else entirely that I may not be aware of. Or perhaps it is possible to use audio input to trigger a random sequence of layers from a swap set? Or perhaps there is a way to trigger different replays randomly when any audio is detected (loudness not being important).

 

Thanks!

 

This topic has been closed for replies.

2 replies

k_oshiro
Community Expert
Community Expert
June 24, 2021

Unfortunately, at present
I think it is difficult to control the key-registered triggers by voice.

If there is another solution, I would like to know it too.
I'm sorry I can't help you.

I hope to see it in a future version.
I will wait for other people's advice.

 

Thank you 

k_oshiro(AdobeCommunityExpert)
Participant
June 24, 2021

Thank you. I'm really hoping that this is possible and someone knows of a solution.

 

k_oshiro
Community Expert
Community Expert
June 23, 2021

I'm not very good at English.
I used some translation software,

but I may not have understood your question correctly.

 

1) Tag the arm layer with a mouth group.
2) Assign a diacritical mark to the arm you recorded as a cycle layer.
3) The arms will move according to the movement of the mouth.

Aa makes the left arm go up.
Oh will make it say bye bye.

 

A sample puppet has been uploaded to Dropbox.

https://www.dropbox.com/s/c3aar6llkiy0xht/mouse_hand.puppet?dl=0


Explanatory video uploaded to YouTube. (Japanese)

https://youtu.be/51uqdUfdCuk

 

Thank you.

k_oshiro(AdobeCommunityExpert)
Participant
June 24, 2021

Thank you! This is helpful.

 Do you know if it is possible to show a Replay when certain sounds are spoken, “Oo", "Aa", etc?  I know how to create replays and show them when a trigger key is pressed, but is there a way to show specific replays based on audio input (when specific sounds heard)? Or show a swap set (having many replays) based on audio input (when specific sounds heard)? 

Thank you!

 

Participant
June 24, 2021

@k_oshiro I very much appreciate your generosity in sharing the puppet file. I am trying to show a replay (https://www.youtube.com/watch?v=mZioGOAt8REbased on audio input (when specific sounds heard). Or show a swap set (having many replays) based on audio input (when specific sounds heard). Is this possible?