Skip to main content
Participant
March 24, 2023
Released

P: Inpainting for text to image

  • March 24, 2023
  • 35 replies
  • 4961 views

I would really love a feature where we can specify the part of the AI-generated art that we want to change. Instead of having the AI generate new pictures each time, with completely random changes, I want to be able to specify which parts I have a problem with. For example, if the hands are not realistic, I want to be able to select them and generate images with just the hands changed (everything else the same). Or, if I really like the picture, but want to the see it in a purple hue, i want to be able to do that. I understand it might be really difficult to implement though. 

35 replies

Tracy.H
Community Manager
Community Manager
April 11, 2023

@biagiodistefano Merging you into this thread so we can track the demand for certain features

Participant
April 11, 2023

In "text to image" it would be convenient to be able to select, after sending the prompt and one of the results proposed by Firefly, a specific area of the image on which a modification or addition is requested with a dedicated prompt. This is because many times the requested results are great, but there are some small areas that you don't like or where you would like to try to put other elements.

Byron Smith
Community Expert
Community Expert
March 29, 2023
This is exactly what I think would make the most sense.

Sent from Outlook for iOS<>
The rising tide raises all ships.
The Scott Valentine
Community Expert
Community Expert
March 29, 2023

The general request in this thread is to enable "hinting," or the ability to mark a region to give the engine some direction and constraints. A great way to experience this would be to create a painted or enclosed region, then apply a secondary prompt to describe the changes for that area. Something like "smooth the skin" or "change this grass to mud" or everyone's favorite "give this person the appropriate number of limbs/digits" 😄

------------------------------------------------------------Never let your tools get in the way of your art!
Byron Smith
Community Expert
Community Expert
March 28, 2023

As I jump down the rabbit hole of Holy Adobe power I realize one thing that would definitely increase the generation of content is by being able to retain certain aspects of a piece while enabling other variations. It would be great if you could select the things you want to retain before generating iterations.

The rising tide raises all ships.
Participating Frequently
March 27, 2023

OK, I see the dots now. So you can't use one of your own images as a reference, only one which Firefly previously created. I really hope the option of using an uploaded image as reference will be added.

Participating Frequently
March 27, 2023

I was about submit a suggestion to allow an uploaded image to be used as part of the prompt in Text to Image, but the "Use as reference image" feature you mention implies it already exists. Alas, I cannot find the "..." menu anywhere. Can you point me to it?

Participant
March 27, 2023

I hadn't seen the video. It's almost exactly what I was thinking of. I hope to see this feature soon!

March 26, 2023

Would be great if users can have masking brush tool for selecting parts of the image with distorted details. AI task would be to improve details on that part or remove strange objects which often appears on image. 

Tracy.H
Community Manager
Community Manager
March 26, 2023

Thank you for the feedback! Inpainting is a feature on our roadmap.

Tracy.H
Community Manager
Community Manager
March 26, 2023

Thank you for your feedback! Have you tried the "Use as reference image" feature under the "..." menu when hovering over the image? You can change the prompt to adjust your image. You're other suggestion regarding replacing a specific part of the image may be addressed with Inpainting. It's not released yet, but you can see it in

this video

.