Skip to main content
D
Community Expert
DeanUtianCommunity Expert
Community Expert
January 25, 2025
Open for Voting

Firefly video enhancement with first/last frame images

  • January 25, 2025
  • 2 replies
  • 1520 views

From a previous discussion, and what had been confirmed through various tests, when you insert images for the first and last frame when generating a video, Firefly will attempt to create an animated transition between the 2 images. That's because the start and end frames will generally be an exact match in the created video and Firefly is trying to create a seamless animation between them. This can create cool results if that's what you're intending but it can be limiting as well.

Here's one experience
I uploaded contrasting images for the first and last frame. The images were very different in content and style. I then used the prompt "umbrella opening and closing". Note, there was no umbrella in either image.

Result
A cool animated effect starting from my first frame strasforming into an umbrella shape and then folding into the last fame image. 
The problem was that it left a small umbrella in the last frame.

I tried again and got multiple umbrellas appearing and then when it got to the last frame, the umbrella moved off the screen,

Now this may be a great result if that's what ins intended. However, what if you want the first and last frame to be background images for new content placed over or within the images? 

Another experience
Using different images for the first and last frame, I used the prompt:
"spaceship chasing a dragon:

The result was quite cool. It wasn't exactly accurate, inserting a spaceship-dragon mix over my image, that turns, almost fills the frame, and then flys into the second image, revelaing more of it. The first part of the video was much better than the last part, which was consistently the case through multiple attempts with the same images and prompt.

 

The transition was not very polished, but you expect this may happen with some. The main thing that I am unable to control is to avoid the second image being distorted or transformed as part of the image. 

Idea request
It would be beneficial if you could set the first and last frames as a 'background' so Firefly does not change the content, just what happens over them.

    2 replies

    einzelbild
    einzelbild
    Inspiring
    September 2, 2025

    of course I can share it. The start frame is highres.

    I used simple prompts and complex prompts. no difference.

     

    "A slow-motion shot. He smiles at the camera. Fire shoots out of his hands. In the background, a gray sea monster emerges from the water. Water splashes."

     

    "He gestures wildly. He looks around as if he is searching for something but has forgotten what."

     

    "A man wearing a baseball cap smiles warmly, his hands moving in a cool, relaxed gesture. Behind him, a golden steampunk submarine emerges from the water, its intricate gears and brass details gleaming in the sunlight. The background reveals a tranquil lake with ripples on the surface, suggesting a serene outdoor setting. The camera captures the man from a slightly low angle, focusing on his face and hands, while the submarine adds a fantastical element to the scene. The overall style is whimsical and detailed, emphasizing the man's contentment and the futuristic submarine's elegance."

     

    "the man is moving is hands in a calm way. he has 5 fingers on every hand. behind him a golden steampunk submarine surfaces behind him. the camera is steady."

     

    The movement was quite good and matched the prompts mostly. The fire from the hands looked impressive, hard to replicate without AI or a fire simulation. The "5 finger" part was only good to let him show his fingers. But in the last test there were 6 fingers.

     

    "the man is moving is hands in a calm way. he has 5 fingers on every hand. behind him a golden steampunk submarine surfaces from under the water behind him. the camera is steady. keep the face consistent to the startframe."

    this gave me the best face consistency.

    Is this a way to write the prompt? or was this just a coincidence?

     

     

    but the fingers are a big problem. Face I could fix later but creating fingers is too much to fix.

    "the man is moving is hands in a calm way. he makes a step toward the camera. behind him a golden steampunk submarine surfaces from under the water. water is splashing, stream is coming form the sunmarine. the camera is steady. keep the face consistent to the startframe."

     

    Kartika Rawat
    Community Manager
    Kartika RawatCommunity Manager
    Community Manager
    September 5, 2025

    Thanks for sharing the detailed post. Currently, Firefly has limitations in creating realistic body features in generated images/ videos. The quality of our models will improve with time, and generated content will continue to better follow prompts. Select the thumb icon to provide feedback about distorted facial or body features.

     

    Let us know if you have any questions. 
    ^KR

    einzelbild
    einzelbild
    Inspiring
    August 26, 2025

    I had similar results. Especially faces aren't consistent even with two frames.

    It would be fantastic to have a result which looks more like what runway is doing.

    Kartika Rawat
    Community Manager
    Kartika RawatCommunity Manager
    Community Manager
    August 28, 2025

    Hi einzelbild!

    Thanks for writing in. Could you share your generated images and the prompts?

     

    ^KR

    Terms & ConditionsAccessibility statement
    Using the community Terms of use Privacy Cookie preferences Do not sell or share my personal information ad choicesAdChoices