I'm not sure if this is eaxctly a bug or just a deficiency in what Firefly video can do at this moment, but here is what I've experienced.
The version of Firefly Generate Video as of today (23 Jan 2025) allows you to add images to act as the first and last frame. I have been experimenting with having the same image for both the first and last frame. My intension is to create a short loop with a subject that animates with a consistent visual character. I have not had much success on this front.
Attempt 1 Steps:
1. Upload an image to first and last frame in Firefly video. Image is of a colourful animal created as a static image with Firefly Text to Image.
2. Add the prompt "Colourful bright animal talking".
Result (after multiple attempts with different images but always first and last frame having matching image)
A 5 second video with nothing happening.
I did get an attempt with a subtle animation of the ears, another of the fur.
Expected result
The animal in the image moving its mouth with the background remaining the same.
Other attempts
I tried the same thing (same image and prompt as above) with just the first frame having a reference image.
Result
The video shows animation of the animal opening its mouth - not a talking type movement.
Plus the fur and other parts of the animal animating (waving fur, growing, changing colour).
Another attempt had the head turning and changing into a slighly different version of the animal.
Expected result
My intension was for only the mouth to animate.
Further attempts
Back with the images the same for first and last frame, I tried 'blinking' or 'winking' in the prompt instead of 'talking'. I did get some animation but a very distorted result.
From my testing, it I feel that Firefly video is lacking of controls/settings to ensure it knows when to remain consistent vs when to change things (and what to change). If you have a first frame reference image, you can't gurantee your subject will have consistency as it animates or the background will remain unchanged. If you have both first and last frames the same, Firefly video has trouble animating, particularly with the term "talking".