I am trying to create previews for walking trails by capturing a time lapse while walking the trail using a GoPro and then pulling the stills into Photoshop/Premiere do a time-lapse. The resulting video is looks very jumpy no matter what fps I use during the Premiere export. I used the MS "Hyperlapse" tool, back when it was free, to do the opposite--video as input and a simulated time-lapse as output. The result from that was a lot more smooth as I recall. This isn't surprise since they start with a *lot* more frames and I assume they are throwing some frames away and then interpolating.
My question is whether or not there is any way do smoothing across the input stills in a time lapse to try and smooth it out a little. Have the full suite license so any of the CC tools are fair game (although I mostly know Premiere and Photoshop)
The GoPro ranges from 1 frame for 0.5 sec to 1/Minute. I am running it at 1 sec. to produce the stills (and I walk pretty slow because I am an old guy).
Using Interpret Footage is unlikely to solve the problem. As the linked article itself says, Interpret Footage is simply a way to properly time-remap frames shot at a high frame rate (such as 60 or 120 frames per second) to the timeline frame rate. This is consistent with what Interpret Footage does in Adobe Premiere Pro and After Effects. But the footage shot by the original poster is not high frame rate footage. It's extremely low frame rate footage with huge time gaps: One frame every few seconds or minutes. That won't benefit from Interpret Footage.
What would help here is to interpolate, not interpret, the frames. Interpolation could improve smoothness by rendering intermediate frames based on the preceding and following frames. In Premiere Pro and After Effects this is called frame blending. I don't think Photoshop has frame blending, and I also don't think it would work well with frames with so much time in between them that there are significant changes in content, edges, and camera orientation. I also don't think the Warp Stabilizer in Premiere Pro or After Effects would help much; like Microsoft Hyperlapse they need lots of similar frames to interpolate from.
Microsoft Hyperlapse might be the best that can be done here. If you look at how Microsoft does it (watch the video below — it's fascinating!), part of the reason MS Hyperlapse can can produce smoother video than the above solutions is that it not only interpolates frames, but also does interpolation of the empty areas that result when adjacent frames are not framed the same (e.g., slighly rotated) as you are walking around taking pictures along your path. To make it look like the camera was always pointed the same way instead of shaking all over the place, it also attempts to reconstruct the 3D path of the camera, through a 3D model of the world that it builds by analyzing the frames. This is all way beyond what any Adobe app I know does. Adobe video stabilization is great for what it's intended for: Normal frame rate video. But for a project like that in the original post, a hyperlapse solution is probably more appropriate. But I haven't looked into whether there are other apps that can do it.
Unfortunately, RAWBlend will not solve the original poster's problem either. RAWBlend looks very cool…I use a similar application called LRTimelapse. Both interpolate exposure settings to smooth out exposure differences, to erase the "jumps" from changing shutter speed or ISO during a time lapse to compensate for rapidly changing light conditions (as in a sunset time lapse). They can also remove subtle exposure flicker that affects time lapses. But these applications will not stabilize spatial jerkiness from frames taken widely spaced in time.
In short:
RAWBlend (and LRTimelapse) interpolate exposure settings only. They will not interpolate or alter image content.
Hyperlapse and video stabilization can manipulate image content through spatial warping, synthesis of edges, 3D modeling, etc.
Was you GoPro used stationary with a stabilizing mounting or on a tripod?. Removing frames from a video or makes a time lapse with image from a moving camera over uneven terrain is bound to be bumpy. There is nothing stable object perspective will change with camera position there is nothing to align frames to. And the camera was most likely not always pointing the same distant point. You have a series of images shot from different points of different areas. A Time lapse is a series of image of a scene where the camera does not move the images capture the changes in the scene composition over time. Shoot video....
Using Interpret Footage is unlikely to solve the problem. As the linked article itself says, Interpret Footage is simply a way to properly time-remap frames shot at a high frame rate (such as 60 or 120 frames per second) to the timeline frame rate. This is consistent with what Interpret Footage does in Adobe Premiere Pro and After Effects. But the footage shot by the original poster is not high frame rate footage. It's extremely low frame rate footage with huge time gaps: One frame every few seconds or minutes. That won't benefit from Interpret Footage.
What would help here is to interpolate, not interpret, the frames. Interpolation could improve smoothness by rendering intermediate frames based on the preceding and following frames. In Premiere Pro and After Effects this is called frame blending. I don't think Photoshop has frame blending, and I also don't think it would work well with frames with so much time in between them that there are significant changes in content, edges, and camera orientation. I also don't think the Warp Stabilizer in Premiere Pro or After Effects would help much; like Microsoft Hyperlapse they need lots of similar frames to interpolate from.
Microsoft Hyperlapse might be the best that can be done here. If you look at how Microsoft does it (watch the video below — it's fascinating!), part of the reason MS Hyperlapse can can produce smoother video than the above solutions is that it not only interpolates frames, but also does interpolation of the empty areas that result when adjacent frames are not framed the same (e.g., slighly rotated) as you are walking around taking pictures along your path. To make it look like the camera was always pointed the same way instead of shaking all over the place, it also attempts to reconstruct the 3D path of the camera, through a 3D model of the world that it builds by analyzing the frames. This is all way beyond what any Adobe app I know does. Adobe video stabilization is great for what it's intended for: Normal frame rate video. But for a project like that in the original post, a hyperlapse solution is probably more appropriate. But I haven't looked into whether there are other apps that can do it.
Just a follow-up. Although MS Research seems to abandoned PRO the company still gives out licenses on request. May want to snag one before they go away too. It is a unique tool.
AdChoices