• Global community
    • Language:
      • Deutsch
      • English
      • Español
      • Français
      • Português
  • 日本語コミュニティ
    Dedicated community for Japanese speakers
  • 한국 커뮤니티
    Dedicated community for Korean speakers
Exit
48

P: Inpainting for text to image

Community Beginner ,
Mar 26, 2023 Mar 26, 2023

Copy link to clipboard

Copied

I would really love a feature where we can specify the part of the AI-generated art that we want to change. Instead of having the AI generate new pictures each time, with completely random changes, I want to be able to specify which parts I have a problem with. For example, if the hands are not realistic, I want to be able to select them and generate images with just the hands changed (everything else the same). Or, if I really like the picture, but want to the see it in a purple hue, i want to be able to do that. I understand it might be really difficult to implement though. 

Idea Released

Views

1.7K

Translate

Translate

Report

Report
Community guidelines
Be kind and respectful, give credit to the original source of content, and search for duplicates before posting. Learn more
community guidelines

correct answers 3 Pinned Replies

Adobe Employee , Mar 25, 2023 Mar 25, 2023

This is a wonderful suggestion. Have you checked out this video which shows inpainting? (Merging all requests for this feature here so we can track the demand for it)

Votes

Translate

Translate
Adobe Employee , Mar 26, 2023 Mar 26, 2023

Thank you for your feedback! Have you tried the "Use as reference image" feature under the "..." menu when hovering over the image? You can change the prompt to adjust your image. You're other suggestion regarding replacing a specific part of the image may be addressed with Inpainting. It's not released yet, but you can see it in

this video

.

Votes

Translate

Translate
Adobe Employee , May 23, 2023 May 23, 2023

We have released the Generative Fill module in Firefly and in the Photoshop beta. Please give it a try!

Status Released

Votes

Translate

Translate
46 Comments
New Here ,
Mar 24, 2023 Mar 24, 2023

Copy link to clipboard

Copied

Muchas veces la IA realiza algunas partes de la imagen de forma extraña y otras de forma correcta, si se le pudiera decir que modifique solo una parte, con una sencilla seleccion (como en Photoshop) 

Votes

Translate

Translate

Report

Report
New Here ,
Mar 24, 2023 Mar 24, 2023

Copy link to clipboard

Copied

Perhaps adding a feature like "redefine". Maybe this could be a simple slider, that adds / subtracts detail almost in an HDR type of fashion.

Votes

Translate

Translate

Report

Report
New Here ,
Mar 24, 2023 Mar 24, 2023

Copy link to clipboard

Copied

Would you use a feature to select components or image area to keep or replace before next iteration?

Votes

Translate

Translate

Report

Report
Adobe Employee ,
Mar 24, 2023 Mar 24, 2023

Copy link to clipboard

Copied

Thank you for your feedback. For now, you can use the "Use as reference image" feature to iterate on a generated image. In the future, we have inpainting and outpainting.

Votes

Translate

Translate

Report

Report
Adobe Employee ,
Mar 24, 2023 Mar 24, 2023

Copy link to clipboard

Copied

Thank you for the suggestion. Have you tried the "Use as reference image" feature? Would like to hear your feedback on this and how your suggestion could be integrated.

Votes

Translate

Translate

Report

Report
Adobe Employee ,
Mar 24, 2023 Mar 24, 2023

Copy link to clipboard

Copied

Have you checked out this video of features we're exploring?

Votes

Translate

Translate

Report

Report
Community Expert ,
Mar 24, 2023 Mar 24, 2023

Copy link to clipboard

Copied

Hola. Según se ve en la web de Adobe, lo que dices será implementado en futuras versiones.

 

Marlon Ceballos.

Votes

Translate

Translate

Report

Report
Community Beginner ,
Mar 25, 2023 Mar 25, 2023

Copy link to clipboard

Copied

Hi!

 

Kinda like how one might use reference image for targetting a specific vision/image.

 

If we had a tool to select specific areas of the image we would like to see a change.

Like in the picture below, I would love to change my "humming cats" tail, remove some freckles and tidy the surroundings.

2023-03-25 12_45_22-2023-03-25 12_43_29-Adobe Firefly (Beta).png ‎- Bilder.png

If I could maintain the general image, but have the ability to target an area or object - By having the option to set the degree of expected difference with each "refresh"/iteration.

Or maybe even add additional prompts for targeted object/area: "This tail is very furry, and curled" / "Tall grass".

 

This would really help increase the efficiency in reaching a high quality result.

 

 Thanks.

Votes

Translate

Translate

Report

Report
New Here ,
Mar 25, 2023 Mar 25, 2023

Copy link to clipboard

Copied

Thank you @Tracy.H . I did try that feature and do love how it visually displays the image reference and has a simple slider. I do though wish it were a little clearer to the user as to what information it is "Using as reference" from the image. I wish that the little pop-up card that shows the selected reference image had perhaps a few more sliders like, sharpen more, or maybe something like "target" and the user could perhaps zoom in or target a specific area of the reference image if let's say I wanted to use that area to focus on. Maybe it could be like a small word prompt field in that small card and when the user focuses on the area to be used as a refernce I can then type in something like "use these colors, + sharpen 50% more + add more detail to the wings only" or soemthing like that. 

Votes

Translate

Translate

Report

Report
Adobe Employee ,
Mar 25, 2023 Mar 25, 2023

Copy link to clipboard

Copied

This is a wonderful suggestion. Have you checked out this video which shows inpainting? (Merging all requests for this feature here so we can track the demand for it)

Votes

Translate

Translate

Report

Report
Adobe Employee ,
Mar 25, 2023 Mar 25, 2023

Copy link to clipboard

Copied

Thank you for the additional ideas @Aries1111 

Votes

Translate

Translate

Report

Report
New Here ,
Mar 25, 2023 Mar 25, 2023

Copy link to clipboard

Copied

Edits will be a big part of generative AI art and maybe calculating masks for prominent objects, like the technology already does with the object tool in PS, could be a great method for doing it. There will always be work left for retouchers, unless of course the next beta drop has a "edit the  _______ "  prompt that only edits the part of the artwork you reference! 

Gary Ferster

Votes

Translate

Translate

Report

Report
Community Beginner ,
Mar 26, 2023 Mar 26, 2023

Copy link to clipboard

Copied

Ooohoo, this is exactly it!

+ + Alot more cool stuff in the video!

 

Will they be usable on the beta soon? Seems to be locked for now.

Thanks

Votes

Translate

Translate

Report

Report
Adobe Employee ,
Mar 26, 2023 Mar 26, 2023

Copy link to clipboard

Copied

Thank you for the suggestion. Inpainting is on our map of future features however we haven't yet determined how it will be integrated in our beta tool.

Votes

Translate

Translate

Report

Report
Adobe Employee ,
Mar 26, 2023 Mar 26, 2023

Copy link to clipboard

Copied

Thank you for your feedback! Have you tried the "Use as reference image" feature under the "..." menu when hovering over the image? You can change the prompt to adjust your image. You're other suggestion regarding replacing a specific part of the image may be addressed with Inpainting. It's not released yet, but you can see it in

this video

.

Votes

Translate

Translate

Report

Report
Guest
Mar 26, 2023 Mar 26, 2023

Copy link to clipboard

Copied

Would be great if users can have masking brush tool for selecting parts of the image with distorted details. AI task would be to improve details on that part or remove strange objects which often appears on image. 

Votes

Translate

Translate

Report

Report
Adobe Employee ,
Mar 26, 2023 Mar 26, 2023

Copy link to clipboard

Copied

Thank you for the feedback! Inpainting is a feature on our roadmap.

Votes

Translate

Translate

Report

Report
Community Beginner ,
Mar 27, 2023 Mar 27, 2023

Copy link to clipboard

Copied

I hadn't seen the video. It's almost exactly what I was thinking of. I hope to see this feature soon!

Votes

Translate

Translate

Report

Report
Explorer ,
Mar 27, 2023 Mar 27, 2023

Copy link to clipboard

Copied

I was about submit a suggestion to allow an uploaded image to be used as part of the prompt in Text to Image, but the "Use as reference image" feature you mention implies it already exists. Alas, I cannot find the "..." menu anywhere. Can you point me to it?

Votes

Translate

Translate

Report

Report
Explorer ,
Mar 27, 2023 Mar 27, 2023

Copy link to clipboard

Copied

OK, I see the dots now. So you can't use one of your own images as a reference, only one which Firefly previously created. I really hope the option of using an uploaded image as reference will be added.

Votes

Translate

Translate

Report

Report
New Here ,
Mar 28, 2023 Mar 28, 2023

Copy link to clipboard

Copied

As I jump down the rabbit hole of Holy Adobe power I realize one thing that would definitely increase the generation of content is by being able to retain certain aspects of a piece while enabling other variations. It would be great if you could select the things you want to retain before generating iterations.

The rising tide raises all ships.

Votes

Translate

Translate

Report

Report
Community Expert ,
Mar 29, 2023 Mar 29, 2023

Copy link to clipboard

Copied

The general request in this thread is to enable "hinting," or the ability to mark a region to give the engine some direction and constraints. A great way to experience this would be to create a painted or enclosed region, then apply a secondary prompt to describe the changes for that area. Something like "smooth the skin" or "change this grass to mud" or everyone's favorite "give this person the appropriate number of limbs/digits" 😄

------------------------------------------------------------
Never let your tools get in the way of your art!

Votes

Translate

Translate

Report

Report
New Here ,
Mar 29, 2023 Mar 29, 2023

Copy link to clipboard

Copied

This is exactly what I think would make the most sense.

Sent from Outlook for iOS<>
The rising tide raises all ships.

Votes

Translate

Translate

Report

Report
New Here ,
Apr 11, 2023 Apr 11, 2023

Copy link to clipboard

Copied

In "text to image" it would be convenient to be able to select, after sending the prompt and one of the results proposed by Firefly, a specific area of the image on which a modification or addition is requested with a dedicated prompt. This is because many times the requested results are great, but there are some small areas that you don't like or where you would like to try to put other elements.

Votes

Translate

Translate

Report

Report
Adobe Employee ,
Apr 11, 2023 Apr 11, 2023

Copy link to clipboard

Copied

@biagiodistefano Merging you into this thread so we can track the demand for certain features

Votes

Translate

Translate

Report

Report