Video moves a way outta frame when I playback and returns in the frame as I stop

[AndrewTheGreat]

Hi. Another Premiere Pro glitch. The footage is iPhone 11 mov-files. The video drivers are up to date. The sequence is old or new - no matter. The video just goes out of the frame a bit when I play back. Tried different preview resolutions. This happens only when CUDA acceleration is on, the Mercury renderer works fine. 

Just watch the video: https://drive.google.com/file/d/1tH_t3cqCe1WDyGazNBe--6UXCOKf1-DI/view?usp=share_link

[Ali Jaber · Accepted solution]

Something similar happens with me when I add a "Warp Stabilizer" effect to a resized 4K clip in a full HD sequence. My workaround is this: I reset the motion, then add a "Transform" effect, and scale down the clip using it, and it magically works...

Give it a try and see if it works in your case.

[AndrewTheGreat]

This worked, thanx. There's an obvious problem in Premiere Pro though, this shouldn't get one use any workarounds...

[R Neil Haugen]

This forum is still mostly user-to-user help. Thanks for posting here, as it does give the rest of us an idea of issues, and means someone else with this will see it.

But PLEASE ... post this in great detail over on their Premiere Pro UserVoice  site, as for Premiere, that is still the best input portal to the devs. All posts there are manually logged into their internal system, assigned to the specific team involved.

Then post a link on this thread to that UV post, so others can go upvote & comment there.

And yes, I've talked with the engineers that do this loggin-in process in-person. Their one complaint ... the vast majority of bug/performance posts do not give NEARLY the detail needed for helping them to isolate the problem. So both of you should post on (hopefully) the same posting there.

And "X is broke, fix it ... " which is by far the most common type of post, is essentially useless. If they don't have a system where X is broke, that ain't helpful, is it? So give your system specs, the media/effects involved ... steps that cause the problem ... as these types of things are as much a nightmare for the devs as they are for us.

Neil

[Ali Jaber]

Honestly, I was too lazy to investigate the reason behind this behavior as it doesn't always happen, and the workaround was really fast and effective.

[Phillip Harvey]

I would also try going to Preferences > Media, and disabling Hardware Accelerated Encoding/Decoding and see if that helps.  

At least in the case of the OP, phone footage is some of the most unpredictable, problematic media you can work with, and I wouldn't be surprised if it was related to the issue. The codec in combination with having Variable Framerate can be a major issue.

[Ali Jaber]

In my case (with warp stabilizer) turning Hardware acceleration solved the problem, but it wasn't a practical solution.

[Phillip Harvey]

Just for clarity since the OP mentioned changing the renderer. The hardware accelerated encoding/decoding option is not the same thing as that. That feature was relatively new, affects playback of unoptimized editing codecs like H264/5 only, and when it comes to VFR media it can cause more harm than good. Again - not suggesting turning the GPU off as the renderer for the software, just the GPU acceleration for H264/5 feature.

[AndrewTheGreat]

I posted it, spoke to tech suppurt wrote letters to adobe. 2023, the latest PP version and I still have to use workarounds because the problem is still there.

[R Neil Haugen]

Is that VFR media?

[AndrewTheGreat]

IPhone 12 movs. 

[R Neil Haugen]

If you use the free utility ShutterEncoder to convert those files to CFR, constant frame rate, do you get proper performance?

Long-GOP clips force the computer to create quite a few frames at once before they can complete any specific frame, it's the nature of the compression format.

So I'm wondering if this is due to that whole thing of sections of the video being in frame groups. If converting that VFR to CFR 'fixes' the issue, that would seem to be the case.

Neil

[AndrewTheGreat]

The problem lies in the IPhone footage only. I have lots of different videos from different cameras and with a different framerate within one shooting and none of them has any problems. I tested it in all the poissible ways. Should I use IPhone footage, there is what is in the screenshots down below (in them you can see what happens when I play back or scrab trough the timeline'change scale).

[R Neil Haugen]

Install the free (and amazing) utility ShutterEncoder. It uses a fairly decent UI to run ffmeg, the major open-source (and all command-line) long-GOP engine.

In ShutterEncoder use the controls to convert that VFR ... variable frame-rate ... to CFR ... constant frame-rate ... media.

Replace the original VFR clips with the CFR ones, and you will probaly be working away.

Neil

[AndrewTheGreat]

Neil, I appreciate your effort of help, but I know workarounds. What I need
is get the software I paid for to WORK as professional software. I don't
have such problems in Davinchi, Filmira nor I have such in Final Cut on my
Mac.

[R Neil Haugen]

As a user, on this primarily user-to-user forum, I suggest things that may help get people working now. I can't fix the app, that takes MONTHS once they've decided to work on something, so I couldn't care a fig about that mostly.

So ... post a bug thing if you want, or Idea ... but ... realistically ... you wanna work with VFR media in Pr, what just always works... now ... is ... convert. Doesn't take more than a few seconds of time, and ... it works while you're doing something else.

Ranting can also be fine here, like most, I've certainly had a few epic ones. But in general, most of us "regulars" just tend to figure out how to get stuff out the door as-is.

Some people of course prefer to yell and scream and get nothing actually done. It just feels better, I suppose. Always a personal choice involved.

Neil

[AndrewTheGreat]

Hi. An update on this. Premiere Pro 2023.2? this issue is STILL there with EVERY 4k video with warp stabilizer applied. I had a wonderful chat with Adobe Support, spent about 4 hours with them to try and resolve this issue and this did not help. I sent the files in question (both IPhone and downloaded 4k footage) and they say they had no problem with those. So I suppose the problem lies in my Premiere Pro settings but we didn't find which ones. The only time it seemed to get fixed was when I removed all the third party plugins folder from the Adobe Common folder. But I do not have any distructive plugins there and I did not actually use them a lot - only the AtomX transitions, Film Impact transitions and the Misterhorse Premiere Composer (transitions and some simple motion graphics mainly). All of them are found either under the Effects tab or as a separate tab from the Extensions menu. And after I removed those plugins and created a new sequience to test the files out, it worked. But for a minute or two - then it started back again even WITHOUS all those third party plugins. So I suppose the problem appears after womething happens in a freshly installed PP not connected with third party plugins. As far as I remember, the next step after I removed the plugins and checked the 4k footage with Warp Stabilizer was adding my custom S-key shortcut for "Add edit" command in the keyboard shortcuts menu - after this every 4k footage started acting glitchy again. Yeah, I don't see a connection here either.

So for now the only way to fix this is adding .1 to a footage scale.

By the way, I forgot to mention that by default media scaling set to "Set to frame size" for every footage in PP preferences, so any 4k getting into my sequences is automatocally set to Scale 50. May be this is why Adobe Support could not reproduce this issue, so please check.

Once again: set the default media scaling set to "Set to frame size" (Preferences > Media), create a 1080p sequence, add a 4k footage and keep the sequence settings for it, add a warp stabilizer to the footage and stabilize it, Play the stabilized footage.

[Ali Jaber]

Have you tried my workaround: Reset motion, add transform effect with scale set to 50%, after the transform effect add the Warp Stabilizer.

Let us know if it works for you.