Skip to main content
Participant
February 12, 2024
Question

Lip sync with external audio after publish

  • February 12, 2024
  • 1 reply
  • 128 views

Say I'm generating audio dynamically, how would I pass the audio into the exported code to lip sync the generated audio (TTS) in an HTML5/JS context.

 

Is it possible to do some sort of

movieClip.gotoAndPlay(audioFile)

 

How would it be possible to achieve this?

This topic has been closed for replies.

1 reply

kglad
Community Expert
Community Expert
February 13, 2024

is this an as3 project?

Participant
February 13, 2024

I'm currently prototyping a scenario of exporting a character with various animations as movieclips to html5/js, and then making them say dynamically generated audio from something like elevenlabs from outside the canvas. I have the fla files of the characters, so can edit them, and have already been setup for lipsyncing.

In the exported code the audio file is referenced in 

lib.properties = {
	id: '',
	width: 800,
	height: 600,
	fps: 24,
	color: "#FFFFFF",
	opacity: 1.00,
	manifest: [
		{src:"sounds/audiowav.mp3", id:"audiowav"}
	]
};

And the idea would be that I want to swap that mp3, and rerun the viseme matching - or something.

 

What I want to achieve is a character, on a website, lipsyncing whatever mp3 you upload/provide to it.