Does generative fill without prompt restrict itself to my image?

[DavePinMinn]

Photoshop 2024...

I'm thinking this has been asked, but I don't see it anywhere...

Now that generative fill is no longer beta, if I use it to fill an area of an image without using a text prompt, does it restrict itself to source pixels in the image?  Or does it grab pixels from other images that aren't mine?  Or create them from nothing?

Same question for the generative expand - does it restrict itself to the image for source pixels?

[DavePinMinn]

What does "upvoting" a post do?  I keep getting email that people are upvoting this topic, but after 24 hours there's no response...

[Trevor.Dennis]

How many upvotes did you get.  You need ten to get your first medal.

[Conrad_C]

I think upvoting a post is a way for people to know that some questions are getting more interest than other questions. But because this is primarily a user-to-user forum, a post with a lot of upvotes does not necessarily mean an answer will arrive any faster, if other users don’t know for sure, because even the users marked Community Experts typically don’t work for Adobe, they’re volunteers.

If you’re lucky, someone who actually works for Adobe and who knows the right answer will notice that people are interested in the question and answer it. But Adobe employees are not obligated to read every post on the user-to-user forum. Adobe employees are known to directly respond more frequently in the Bugs and Ideas (feature requests) sections of this community.

The question is a good one, especially when working for employers or clients who do not want their content mixed with others. But so far there doesn’t seem to be a good FAQ about it. Until Adobe comes in and answers, I think we have to assume that the nature of generative AI means even if you don’t recognize outside content, outside content will at least have influenced the visual result in some way.

[Kevin Stohlmeyer]

@shahbazliaquat that is not correct. Generative Fill is AI driven and uses sources from Adobe Stock and other copyright free sources to create a new layer output based on the original image. So while it does take the original pixel data into consideration - the results are from the AI cloud, not from the local image.

@DavePinMinn this page has more details and FAQ

https://helpx.adobe.com/photoshop/using/generative-fill.html

[Kevin Stohlmeyer]

@shahbazliaquat The Content-Aware features do use source pixels from the image and its immediate context, but that is a completely different set of solutions - not Generative Fill or AI.

[Conrad_C]

This is not an official answer, but I think it might fall into two parts.

Without a prompt, it's only going to make the result consistent with the current document (your image).

But to know how to fill it in properly, I suspect it has to draw on what it has been trained to consider a “good” solution for color, lighting, texture, perspective, etc. based on the how Adobe has guided the AI using the training set of images.

So although the result might not contain any content that recognizably looks like other images, I would guess that the training set (other people’s images) has to influence the result.

[DavePinMinn]

shahbaz, can you provide a link to any documentation from Adobe that will state definitively whether or not generative fill without a text prompt will or will NOT restrict itself to pixels in the current image? 

[Kevin Stohlmeyer]

@DavePinMinn they cant as that comment was wrong. When you use the Generative Fill features (Generative FIll or Expand) your results will contain AI generated content from other sources than your original image.

Here are the FAQs explaining how Generative Fill works:

https://helpx.adobe.com/photoshop/using/generative-fill.html#faq

https://helpx.adobe.com/photoshop/using/generative-ai-faqs-photoshop.html

[DavePinMinn]

Yeah, I read both of those........

Unfortunately, from every competition rule set I've looked at, from local clubs to regional and national, even CAPA in Canada, it means all generative fill, generative AI are banned, and some even won't allow things like content-aware fill and the equivalent.  I suspect the new Remove will fall into that too.

[Kevin Stohlmeyer]

@DavePinMinn Remove tool is definitely a gray area. However with the new context you've shared I can say with 100% certainty that Generative Fill, Firefly, Crop Tool Generative Expand fall under the AI category and would disqualify you from competitions that ban AI usage.

[DavePinMinn]

That's my thinking too.  Realistically, it won't be possible to prevent AI usage without stringent verification.  I believe it's already happening in competitions.  I'll recommend that the local rules be changed to ban generative AI where user-initiated prompts (generally descriptive text) generate the work or any component thereof.  I expect the recommendation will be ignored.

[davescm]

'Realistically, it won't be possible to prevent AI usage without stringent verification'

There are moves to make that verification easier. The content authenticity initiative which Adobe is part of, helps to identify and make the use of AI transparent.

https://contentauthenticity.org/

Dave

[lynnh27894964]

Have there been any answers from Adobe? Our Photo group must know the answer for the sake of our exhibitions, and competitions,

[Kevin Stohlmeyer]

@lynnh27894964 Answers to what? This thread has been supplied all documentation regarding AI usage in Photoshop as it pertains to image usage and restrictions.

As far as a Photo Club rules for exhibitions, contests, etc. it will be up to you to determine what will be allowed or not - AI Generative images, retouching using AI enabled tools like Generative Expand, Remove Tool, Content Aware Fill (AI version), etc.