Video Slow Speed change - clipping extra video length to sync with Audio

[shrikant_explorer]

I am editing a song sequence where the lip sync of video and audio is important as the artistes in the video are shown actually singing the song - like in Bollywood song.

When I slow down a portion of a video clip, it naturally adds extra length to the video (but not the audio), thereby breaking the video and audio sync. I have to then cut of the incremental video clip from immediately succeeding part of the video clip in order to match the audio and video again. This I have to do manually by actually measuring the incremental video clip and then precisely cutting the video clip of same length from succeeding part of the slowed down video portion.

I was wondering if there is any tool in Premiere Pro whereby when I slow down a video clip, it will automatically chop off the succeeding part of the video clip by exactly same amount as the incremental part of the video clip (as a result of the slow speed) on AUTO basis. Please note that there is a lip sync in the song sequence and I can not randomly cut off the video clip nor can I stretch the audio clip.

In all the video tutorials I have seen, this aspect of lip sync is not covered. There is some sort of background music and therefore there is full flexibility in adjusting the audio to match the length of the video. In the case of dialogue, though the lip sync is there, the slowing down of video clip does not occur. This specific issue happens only in the case of song sequence with lip sync.

Thanks in advance for the guidance.

[Ann Bens]

Ae is the way to go for this.

It can timeremap audio also.

[shrikant_explorer]

Sorry Ann. I did not understand. Do you mean to slow down video and audio together ? In that case the lip sync issue will be solved. But the tune of the song will get spoiled. If is just a background music, then not much of an issue. But a audio part of the song may not be 'stretchable' in this manner, if I understand you right.

[rodneyb56060189]

I only have old version of CS6, so your version is different... but maybe similar

In my sample, below, I have music and voice on 1 audio track already mixed...

So, I choose a point where I want to slow video.... I make a cut ( sound and video are linked ) and select the new clip (where I made the cuts ) and I go to clip / speed - duration... and I make it half speed ( 50%) and tell it to not change pitch of music and push the video and audio. That keeps the other parts of the audio ( including lips moving dialogue sync ) in sync.

It DOES RUIN the portion of the music that is playing now in slow motion but with same pitch … because my stuff is already mixed and on same audio track.

Maybe something like that would help ??  If you have NO SOUND (your singing voices in sync ) under the video you want to slow up, maybe you can add sound that is blank in the areas where the voice(s) track would be, so it pushes stuff and stays in sync … I think that would have to be the entire voices singing track... if you know what I mean … I have no clue.. maybe you only have voices where there is actually singing on that track.

??

[rodneyb56060189]

===========

This I have to do manually by actually measuring the incremental video clip and then precisely cutting the video clip of same length from succeeding part

==========

ohhhh, I get it now... you actually are slowing down the lips but the words still stay normal like you see their lips in slo motion but the words are normal and then you have to cut out the pushed video to re sync that stuff...

yikes.

sounds like your current method is probably the best...

[rodneyb56060189]

OH.... I have an idea...

when you cut ( like my sample..)    unlink the sound, move the sound from that clip you are going to slo mo down one audio level... and fill up the HOLE (where sound used to be on audio 1 or whatever ) with BLANK sound... ( just have some blank sound in bin that you can drag in, fit to your HOLE using the playhead and 'snap' to stuff...),

NOW when you expand the video with slo mo it will push all the nice sound to stay in sync and the audio on the lower level stays normal,

[rodneyb56060189]

p.s. don't forget to relink the blank sound to the video

[rodneyb56060189]

maybe just copy paste the sound clip down one level of audio and lower sound volume to ZERO on original sound portion...

I don't really get the end part though... in my head... like, if you keep slowing down the lips here and there, the video gets longer in length and at SOME point... your song will end and you'll have a lot of left over video of people singing …

????

[shrikant_explorer]

When we slow down a video in some part, then obviously the overall video length will increase, without increasing the audio track length, and rightly so because this is a song and the audio should not be 'stretched' to keep the flow and the tune.We need to cut down the additional length of the video to keep the original length of the audio. This should not be done by cutting down the end part. It has to be done by chopping of the immediately succeeding part of the video after the slowed down part. Only then will the video and audio will have proper 'lip sync'.

I hope I am clear.

[shrikant_explorer]

Thanks Bro for the tip.

Your suggestion does solve the problem of lip sync and the total length of (expanded) video and audio is matched. However, inserting blank music space (or some sort of filler music) at the slowed down part of the video will completely break the flow of music of the song and will spoil the overall tune.

I feel the only solution (I will certainly like to be corrected here) is to cut the part immediately succeeding the slowed down portion of video clip by EXACTLY the same incremental amount so that the overall length of the ORIGINAL Video and Audio Clip is maintained, and thereby the lip sync part is taken care of.

The question is HOW ? I have done it manually with some precision efforts. Can it be done by some sort of tool (if one exists) or trick on Auto basis to save the efforts of precise video chopping operations.

For this purpose, I think it doesn't matter if old version of the new version. It is a basic problem. I was just wondering how come it was never covered in any of the video tutotrials on Utube.or on this forum.

______ _

Let me clarify. I do not intend any LITERAL meaning of lip sync. Actually I am editing a video clip of a lady on the flute. There is no 'slowing down of the lip'. What I have done is some interesting and appealing visual part of the clip is slowed down.

[rodneyb56060189]

===========

I feel the only solution (I will certainly like to be corrected here) is to cut the part immediately succeeding the slowed down portion of video clip by EXACTLY the same incremental amount so that the overall length of the ORIGINAL Video and Audio Clip is maintained, and thereby the lip sync part is taken care of.

==========

If you do the cut and drag down unlinked music portion (so it stays exactly same,  like copy paste it down cause the other stuff is gonna be trashed anyway ) at least you'll have THAT as a sort of 'marker' using the playhead and up down arrow keys, to drag your other stuff back so it's continuous … and you don't have to count frames to do your cut …

I guess I'd have to actually DO IT MYSELF to see if what I'm suggesting saves time, etc...but I don't have any samples of stuff to use for that … lip sync stuff I have is too short duration to really test it out ...

sorry

[shrikant_explorer]

You can try your hands on this hit bollywood song. There is part where lip movements are there. You leave them untouched. There are some visuals which doe not show any lip movement, though the song continues to play in the background. You may slow down the video of this visual while maintaining the lip sync of the remaining part.

[rodneyb56060189]

Anne was saying use AE ( After Effects ) instead of PPro…

[shrikant_explorer]

OK. I got it.

But still, the issue remains. The Audio part should not be slowed down alongwith the video part as it will then break the flow and the tune.

Unless, the AE does the auto chopping work of the video part as I have mentioned in my original post and which currently I am doing in a hard labor way.

___ _
P.S. : I am not conversant with AE

[rodneyb56060189]

yeah, it's confusing to me too... cause I never tried to do what you're doing.

basically I was thinking that with the audio portion (that was NOT changed due to being on another level ) that would act as a 'marker' for what you have to slip, slide, or whatever tools you can use, to just DRAG BACK the now extended video (and other audio on A1 that is no longer good to use... it will be deleted after )…  hard to explain.

Without counting frames manually or doing what you're now doing.. to bring everything BACK to normal playback and sync.

Anyway, you probably shouldn't have marked my answer as correct, cause

a) that was Anne's suggestion  and

b) you don't know if it solved your problem yet.

hehe... anyway, good going on doing what you are doing, cause I bet it looks cool and will end up being really nice !

[shrikant_explorer]

OMG. I thought I have only marked your short answer of AE = After Effects will be marked as Correct Answer.

Instead, they have marked my original question itself as 'ANSWERED'. I did not mean that. Thanks for pointing it out.

I have made the correction and marked it as Unanswered.

[shrikant_explorer]

To put it differently, allow me to borrow the concept of 'Rolling Edit'. In similar way, we need 'Rolling Speed Ramping' of Video Track only

[shrikant_explorer · Accepted solution]

Hi,

I got the solution, though not in the way I had planned.

I copied the clip to track 2. Then I locked the track 1 video and audio.

Then I cut the portion of video on track 2 which I want in slow speed and deleted the preceding and succeeding tracks.

Then I made that part into slow speed in track 2. The video and audio on track 1 was left intact.

Done !

As the video and audio on track 1 were left untouched, the issue lip sync was automatically solved. The total length of the clip remained as original. The video played with the slow motion of the specific part I wanted without affecting the lip sync..

[rodneyb56060189]

Wow, cool solution !  Good going and thanks for explaining