Skip to main content
Participant
March 24, 2023
Open for Voting

P: Maintaining a scene or character across different prompts

  • March 24, 2023
  • 150 replies
  • 50935 views

Let's say I wanted to storyboard a script and produce different angles of the same thing. It would be nice to have something that holds on to the core look and objects within the frame so we can get a wide, medium , and close shot of the same scene.

150 replies

Participant
October 28, 2023

pour une histoire, vous pourriez demander de décrire les différents personnage et de les nommer... ainsi lorsque l'on veut générer des illustrations, ses premières images créées par votre IA pourraient être utilisées comme base... on garderait plus de cohérence dans notre travail

Inspiring
October 22, 2023

This technique is FAR, FAR away from what folks are asking for but in the meaantime, I have had some success with this approach.

 

I use the Firefly "slot machine" and arrive at a few characters in a scene that  I am happy with.  I use photoshop and a mask program to isolate the characters.  Then I use just the character  file to seed Firefly along with a description.  I have even had some luck with asking for different views of the subject.  After many generates, I usually come up with several viable views of my chaacter.  I then pick a host scene from Firefly and use Photoshop to overlay a masked version .  I can move the character around fairly convincingly.

 

For example the winged guide fairy in my story was created seperately from the scene.  I guess I could use generative fill but I like to work in Photoshop as I can blend and place with better control.

 





Participating Frequently
October 18, 2023

Lot of neat "coming soon" features in the video you sent, but I didn't see anything about maintaining a consistent character across multiple scenes and situations. Was I missing something or were you referring to a different video?

Participating Frequently
October 18, 2023

I think you can already see there's a huge demand signal for the capability of generating consistent characters across multiple frames and scenes to facilitate video storyboards and all aspects of production workflows. It looks like we can hack our way there but it's currently too time consuming. Please put your best team on this feature as soon as possible!

Participant
October 18, 2023

I see that there is a lot of interest in generating different scenes with a consistent character. Has this been achieved yet?

CSI Productions
Inspiring
October 17, 2023

NOT THE CORRECT ANSWER. This is an issue I (and many others) have commented on (and requested as a feature). This video does not address the continuity of characters between scenes in a storyboard or storybook. Slapping "Correct Answer" on a post does not make it so.

 

If the community is missing something, I'd be interested in attending a FireFly webinar where the steps involved show this in practice - I'm sure many others would appreciate this as well.

 

I'm sure this isn't a simple "bug fix" so I can only imagine what's involved. Still, it's a very common use for FireFly and this would make it insanely popular for obvious reasons.

 

Thank you.

R.CatesCSI ProductionsIf you want peace, be peaceful.
Inspiring
October 17, 2023

Again, thank you!  But the video "teaser" as well as comments in the thread do not get  at solving the issue of "locking -in" a certain look as the story board progesses with different text prompts.  Each re-generation or refresh just produces another "brand -new" rendering which  may or not be compatible with the previous rendering.  

I LOVE Firefly and have quickly outstripped , maybe, its intended purpose.   But I am thirsty for more.  Specifically , the ability to maintain continuity in creating a story board or an illustrated book.

 

I have tried the suggested technique of importing an image to provide a "seed" along with the text but that result was very different and therefore not a solution.

We are hungry for more.  😃

The Scott Valentine
Community Expert
Community Expert
October 15, 2023

I really enjoy the Photo settings sliders, but I have a use case that is not currently met.

 

Changing the Photo settings also changes the image content as if with a new seed. I'd like to simulate shooting the exact same scene with different settings. This would simulate moving the camera when changing focal length or aperture. Retain the same subject composition, such as a bust or full length portrait so that the subject retains the same visual space in the frame.

------------------------------------------------------------Never let your tools get in the way of your art!
Bodhi XV
Participant
October 13, 2023

When creating a landscape and the result of a specific look and feel of a tree is one that we want to keep but the surroundings we want different. It would be welcome to be able to select a object (house, car, trees, etc) and protect their style while the rest regenerated into variations.

Participant
October 12, 2023

Hi,

Have seen image upload and use it style reference and generating image by text, but it would be better if use face exactly as per image and generate.