I'm profoundly deaf. It makes editing audio and visemes a bit of a pain.
In my everyday life, I lip read, and when my brain adds this to the bit, I do hear through the device embedded in my head, I do ok. It works better when I know the person and recognises the mouth movements and the sounds they make. This is a major problem for the alogrythm when trying to lip sync audio. We may speak the same language, but the sound and mouth shape we make it with varies a lot.
I think there is a possible and viable solution.
Over the last few years, I've tried out speech to text apps. These are very good, even with live speech, and it got me to thinking about my struggle with CA and Audio.
Idea:
When you auto lip-sync a piece of audio in CA, wouldn't it be great if it could display the text to go with it?
Better still;
If the text was displayed on its track above the audio file in the Player.
Even Better:
What about if this text was highlighted as you moved the play-head? It would match the text and waveform. This is already done for Karaoke songs, so I'm sure some bright spark at Adobe could work this out.
Plus:
If the viseme track, could also be displayed below the text track, then that would be even more help.
I'm also sure that visemes and text could be another way of syncing.
Think it would be beneficial for everyone, not just deaf old me! It would certainly speed up and aid editing.
Wouild like to know what others think?
3
Replies
AdChoices