Skip to main content
Filmus
Known Participant
December 19, 2024
Open for Voting

Dubbing for the translated video.

  • December 19, 2024
  • 0 replies
  • 368 views

I suppose that if we can already use neural networks to create videos, then it won't be difficult to simply add the function of dubbing the audio track into other languages. Considering that we already have a translation of subtitles, we could probably make the necessary changes to them and press something like the "Dubbing" button, getting an audio track in which all participants would be able to pronounce the text from the subtitles with their own voices. This feature has been available for quite some time both as part of subscriptions to paid services and in free tools on GitHub. It's probably time to implement it in our multifunctional video creation tool. It should be added that there is also technology for synchronizing audio with the speaker's lips. However, this may complicate the task and require more processing time. Probably, this function could be added in updates as one of the settings that can be turned on or left off, focusing only on subtitles.