Skip to main content
F
FeedbackCommunityMember
Inspiring
February 7, 2023
Open for Voting

Support for transcripts/subtitles when auto lip syncing

  • February 7, 2023
  • 2 replies
  • 163 views
Allow support for importing a transcript or subtitle file, so the auto lip sync could analyse both the audio and the transcript for a more accurate result.

If the program knows exactly what words are said, it should presumably have a much better idea of which 'Visemes' to use.
(Though obviously this wouldn't work for a live stream aha!

      2 replies

      CoSA_DaveS
      Adobe Employee
      CoSA_DaveS
      Adobe Employee
      February 7, 2023
      This is now available in the beta version. See https://community.adobe.com/t5/character-animator-beta-discussions/feature-focus-transcript-based-lip-sync/td-p/12189879
      aronm15237262
      aronm15237262
      Known Participant
      February 7, 2023
      The person I have to lip sync to most often is british, so the program has a lot of trouble telling what he's saying. Almost consistenatly, funny enough. Sometimes I get away by changing a few mouth poses to the correct one in photoshop so character animator will read right.
      It would be nice if the program showed the text it thinks the audio says so I could modify that to get a little closer to a final result.
      Terms & ConditionsAccessibility statement
      Using the community Terms of use Privacy Cookie preferences Do not sell or share my personal information ad choicesAdChoices