Skip to main content
Participant
March 24, 2023
Released

P: Maintaining a scene or character across different prompts

  • March 24, 2023
  • 262 replies
  • 53649 views

Let's say I wanted to storyboard a script and produce different angles of the same thing. It would be nice to have something that holds on to the core look and objects within the frame so we can get a wide, medium , and close shot of the same scene.

Pinned Reply By Kevin Stohlmeyer

https://www.adobe.com/learn/firefly/web/create-commercial-storyboard-firefly-boards?learnIn=1&ntd=1

This tutorial on Adobe Learn covers how to maintain consistent characters across multiple storyboards using Firefly Boards. The same method would work using Text to Image generation as well. 

 

262 replies

CSI Productions
Inspiring
November 30, 2023

Did you say you did or did not use FireFly for this sequence of images. If you did, I think this is very close. If not, it gives me hope that at some point we'll have something like this in FF. The without clothes is clearly an issue but as you showed here, neck and shoulders isn't really naked but you probably need to use that in the prompt which would raise a red flag. Moving in the right direction.

R.CatesCSI ProductionsIf you want peace, be peaceful.
Participant
November 30, 2023
Hi Can you share the prompts that you used?
Vince
Matt Matt
Participating Frequently
November 30, 2023

The real answer is that in ANY AI tool (at the current moment) it's not failproof, given the very nature of generative content, which means "random", but the short answer is yes, ROUGHLY speaking. It's never going to be spot on perfect until the engines start refining their learning models. 

Observe: (Currently working on this project)

 

Generated source used a a "Style Reference"
In my explorations I've discovered it's better to have a human character without clothes (Adobe has an obvious limitation here) to that the learning model doesn't try to "force" the clothing in any subsequent generations/scenes. 

 

Now, we generate specific scenes being VERY descriptive. If you're lazy with your prompts your results will be more "guesswork". It's important to note I included the prompt I used in the source image in every new scene/generation, followed by my specific scene descriptors. 

      
As you can see, the results are close, but not spot on. Again, even in Midjourney using the /prefer option set you're NOT going to get 100% likeness in each generation. This is the nature of the AI beast. That being said, Firefly's interface is money.

Overall, I find that as it stands at the current moment, multi-scene application using the same character is not refined enough by the current toolset. It's been a somewhat contentious and frustrating journey trying to force a square peg in the proverbial round hole. This method starts to break down whenever you start adding more varired characters into one scene. Firefly can do it, but the other characters look VERY related to your main character.

I have a deadline, so I'm going to have to soldier through it, but I can't wait to tell my Art Director in post mortem that, "this ain't it".

Right, time to brew more coffee. 

Participant
November 22, 2023

In Adobe photoshop it will be very useful to generate same thing on different photos. For examle in one photo I replace some background stuff and I have almost the same photo but I can generate the same background as on previous picture. PLEASE it is very important button generate as on privious image =)))

IESEGEM
Participant
November 17, 2023

Bonjour,

 

ce serait pertinent d'avoir la possiblité de pouvoir travailler à partir de la même image afin de la faire évoluer dans différentes pauses ou actions. 

Ex : un homme qui sourit, face caméra.

le même homme qui fronce les sourcils et s'interroge, les yeux levés en l'air

le même homme qui salue quelqu'un (hors champs)

etc

 

je vous remercie par avance de votre écoute. 

 

Bonne journée,

[Removed by Mod]

Participant
November 13, 2023

Vous pouvez travailler sur la suggestion en permettant à l'utilisateur d'importer achaque etape de sa modification l'element similaire qu'ils voudrais editer. Cela donnera encore plus de facilité de une correspondance encore plus avancé de ce que desirs le createur

 

Participant
November 10, 2023

Is there a way to have a AI reference image of characters be replicated exactly in other scenes? Using beta 2 firefly

CSI Productions
Inspiring
November 2, 2023

Well to that I say, you are doing the best you can with what you have to work with and I compliment you on that. I suck at carpentry but I still have tools and use YT video tuts to do projects I wouldn't normally try. Like you I enjoy the craftmanship and I find it to be very rewarding. To me, I'm a carpenter, to a carpenter - ha ha ha they'd laugh but, that's ok, it brings me pleasure. Keep going, over time we all improve and Firefly may be just the thing to get people who wouldn't normally build their own media to dip their toes in the water. Fascinating times.

R.CatesCSI ProductionsIf you want peace, be peaceful.
Inspiring
November 2, 2023

I am not blessed with the artist skills of creating characters and scenes.  I am a manipulator or mechanic. I like Firefly and I think it adds a needed tool for me to turn my thoughts and ideas into unique and well crafted images albiet there is a certain "slot machine" aspect to the process.  That is the "new" for  me and a wonderful tool that I can add to my tool-kit.  

 

I need to produce finsished products and not sketches or story boards.  I love Firefly and other forms of AI beacuse it creates new paths for me to follow that I would have never thought about.  So I guess I am a hybrid of AI and natural abilities.  The blend of old tools (blender, photoshop, poser) and new tools (Firefly)  is working for me.

A corollary thought is around text.  Wow,  I get great new story lines from a bullet point list as input but more than often the text, though creative and "new", is stilted or versbose or etc. and I have to turn to old writing skills to hone a new better product.  AI makes me better and expands my work but I'm kinda' glad that I still stay in the process and am part of the creativity.

CSI Productions
Inspiring
November 1, 2023

I could also draw them by hand. I'm well aware of the options available with compositing and I've been aware of poser, blender, Cinema etc etc. The point is to streamline this with Firefly. Another reason this is desperately needed is for storyboarding. I'll just do thumbnails by hand rather than go through the gymnastics you suggest.

 

I appreciate your willingness to suggest workarounds but isn't the whole idea of AI to streamline the production process, not find other ways to do things the way they're done now?

R.CatesCSI ProductionsIf you want peace, be peaceful.