Skip to main content
Inspiring
June 26, 2019
Answered

Video Slow Speed change - clipping extra video length to sync with Audio

  • June 26, 2019
  • 8 replies
  • 5032 views

I am editing a song sequence where the lip sync of video and audio is important as the artistes in the video are shown actually singing the song - like in Bollywood song.

When I slow down a portion of a video clip, it naturally adds extra length to the video (but not the audio), thereby breaking the video and audio sync. I have to then cut of the incremental video clip from immediately succeeding part of the video clip in order to match the audio and video again. This I have to do manually by actually measuring the incremental video clip and then precisely cutting the video clip of same length from succeeding part of the slowed down video portion.

I was wondering if there is any tool in Premiere Pro whereby when I slow down a video clip, it will automatically chop off the succeeding part of the video clip by exactly same amount as the incremental part of the video clip (as a result of the slow speed) on AUTO basis. Please note that there is a lip sync in the song sequence and I can not randomly cut off the video clip nor can I stretch the audio clip.

In all the video tutorials I have seen, this aspect of lip sync is not covered. There is some sort of background music and therefore there is full flexibility in adjusting the audio to match the length of the video. In the case of dialogue, though the lip sync is there, the slowing down of video clip does not occur. This specific issue happens only in the case of song sequence with lip sync.

Thanks in advance for the guidance.

This topic has been closed for replies.
Correct answer shrikant_explorer

Hi,

I got the solution, though not in the way I had planned.

I copied the clip to track 2. Then I locked the track 1 video and audio.

Then I cut the portion of video on track 2 which I want in slow speed and deleted the preceding and succeeding tracks.

Then I made that part into slow speed in track 2. The video and audio on track 1 was left intact.

Done !

As the video and audio on track 1 were left untouched, the issue lip sync was automatically solved. The total length of the clip remained as original. The video played with the slow motion of the specific part I wanted without affecting the lip sync..

8 replies

Legend
July 16, 2019

Wow, cool solution !  Good going and thanks for explaining

shrikant_explorerAuthorCorrect answer
Inspiring
July 16, 2019

Hi,

I got the solution, though not in the way I had planned.

I copied the clip to track 2. Then I locked the track 1 video and audio.

Then I cut the portion of video on track 2 which I want in slow speed and deleted the preceding and succeeding tracks.

Then I made that part into slow speed in track 2. The video and audio on track 1 was left intact.

Done !

As the video and audio on track 1 were left untouched, the issue lip sync was automatically solved. The total length of the clip remained as original. The video played with the slow motion of the specific part I wanted without affecting the lip sync..

Inspiring
June 26, 2019

To put it differently, allow me to borrow the concept of 'Rolling Edit'. In similar way, we need 'Rolling Speed Ramping' of Video Track only

Legend
June 26, 2019

yeah, it's confusing to me too... cause I never tried to do what you're doing.

basically I was thinking that with the audio portion (that was NOT changed due to being on another level ) that would act as a 'marker' for what you have to slip, slide, or whatever tools you can use, to just DRAG BACK the now extended video (and other audio on A1 that is no longer good to use... it will be deleted after )…  hard to explain.

Without counting frames manually or doing what you're now doing.. to bring everything BACK to normal playback and sync.

Anyway, you probably shouldn't have marked my answer as correct, cause

a) that was Anne's suggestion  and

b) you don't know if it solved your problem yet.

hehe... anyway, good going on doing what you are doing, cause I bet it looks cool and will end up being really nice !

Inspiring
June 26, 2019

OMG. I thought I have only marked your short answer of AE = After Effects will be marked as Correct Answer.

Instead, they have marked my original question itself as 'ANSWERED'. I did not mean that. Thanks for pointing it out.

I have made the correction and marked it as Unanswered.

Legend
June 26, 2019

Anne was saying use AE ( After Effects ) instead of PPro…

Inspiring
June 26, 2019

OK. I got it.

But still, the issue remains. The Audio part should not be slowed down alongwith the video part as it will then break the flow and the tune.

Unless, the AE does the auto chopping work of the video part as I have mentioned in my original post and which currently I am doing in a hard labor way.

___ _
P.S. : I am not conversant with AE

Legend
June 26, 2019

===========

I feel the only solution (I will certainly like to be corrected here) is to cut the part immediately succeeding the slowed down portion of video clip by EXACTLY the same incremental amount so that the overall length of the ORIGINAL Video and Audio Clip is maintained, and thereby the lip sync part is taken care of.

==========

If you do the cut and drag down unlinked music portion (so it stays exactly same,  like copy paste it down cause the other stuff is gonna be trashed anyway ) at least you'll have THAT as a sort of 'marker' using the playhead and up down arrow keys, to drag your other stuff back so it's continuous … and you don't have to count frames to do your cut …

I guess I'd have to actually DO IT MYSELF to see if what I'm suggesting saves time, etc...but I don't have any samples of stuff to use for that … lip sync stuff I have is too short duration to really test it out ...

sorry

Inspiring
June 26, 2019

You can try your hands on this hit bollywood song. There is part where lip movements are there. You leave them untouched. There are some visuals which doe not show any lip movement, though the song continues to play in the background. You may slow down the video of this visual while maintaining the lip sync of the remaining part.

Legend
June 26, 2019

I only have old version of CS6, so your version is different... but maybe similar

In my sample, below, I have music and voice on 1 audio track already mixed...

So, I choose a point where I want to slow video.... I make a cut ( sound and video are linked ) and select the new clip (where I made the cuts ) and I go to clip / speed - duration... and I make it half speed ( 50%) and tell it to not change pitch of music and push the video and audio. That keeps the other parts of the audio ( including lips moving dialogue sync ) in sync.

It DOES RUIN the portion of the music that is playing now in slow motion but with same pitch … because my stuff is already mixed and on same audio track.

Maybe something like that would help ??  If you have NO SOUND (your singing voices in sync ) under the video you want to slow up, maybe you can add sound that is blank in the areas where the voice(s) track would be, so it pushes stuff and stays in sync … I think that would have to be the entire voices singing track... if you know what I mean … I have no clue.. maybe you only have voices where there is actually singing on that track.

??

Legend
June 26, 2019

===========

This I have to do manually by actually measuring the incremental video clip and then precisely cutting the video clip of same length from succeeding part

==========

ohhhh, I get it now... you actually are slowing down the lips but the words still stay normal like you see their lips in slo motion but the words are normal and then you have to cut out the pushed video to re sync that stuff...

yikes.

sounds like your current method is probably the best...

Legend
June 26, 2019

OH.... I have an idea...

when you cut ( like my sample..)    unlink the sound, move the sound from that clip you are going to slo mo down one audio level... and fill up the HOLE (where sound used to be on audio 1 or whatever ) with BLANK sound... ( just have some blank sound in bin that you can drag in, fit to your HOLE using the playhead and 'snap' to stuff...),

NOW when you expand the video with slo mo it will push all the nice sound to stay in sync and the audio on the lower level stays normal,

Ann Bens
Community Expert
Community Expert
June 26, 2019

Ae is the way to go for this.

It can timeremap audio also.

Inspiring
June 26, 2019

Sorry Ann. I did not understand. Do you mean to slow down video and audio together ? In that case the lip sync issue will be solved. But the tune of the song will get spoiled. If is just a background music, then not much of an issue. But a audio part of the song may not be 'stretchable' in this manner, if I understand you right.