P: Generated images violate user guidelines

[Hematita]

So as you can see, it's a PG-13 relatively inoffensive image of a woman in a bunny outfit. The top worked fine, and I was able to complete the top ear, which is cool. When I tried to extend the bottom with generative fill, though, I got this warning. They're just a pair of legs wearing stockings, and I wanted to extend it.

It feels like a false flag - though I could be wrong? I find myself thinking it would do the same for women in swimsuits.

Figured I'd share here.

[daniellei4510]

Also, you should make your selection roughly in the shape of what you want created. This gives the bot a better idea of what it has to work with.

[Gordon30403982akk6]

You can also just press the space bar once to add a blank space in the prompt. That sometimes helps with the error message, too. 🙂

[Kevinzacher]

The content restrictons can be limiting.  I am working on an image of a fashion model fully clothed shadow boxing towards the camera.  She is smiling and it is a fun image.  Since when is boxing inaproprite anyway.  

Hope you can correct this limitation.

[Ray26434972uq1g]

This worked for my images, no error

[Sarah27914909k9u3]

Thanks for your reply, Michael. I don't think it's really about the words in the prompt. I say that because sometimes Photoshop redacts a couple of the generated images for "violating community guidelines," but allows another one to get through. It almost seems as if, if the generated result contains too much skin-like color, then it rejects it. For example, say I've generated a beautiful woman but she has six fingers and no thumb. Maybe I select one of the fingers and ask the generative fill to create a thumb here. Sometimes some of those queries get rejected. There's absolutely nothing sexual about practically any of my asks, but my subjects are often both men and women with some AI-generated flaw. And that's really my point. My requests are in no way sexual, but the AI chokes on them anyway. It's very frustrating! Especially because I know this would be an amazing feature — if only I could consistently use it.

[daniellei4510]

This is a case where I would use the Remove tool instead of generative fill.

[johnb60867848]

Sometimes it IS about the words in the prompt.  I find some words will result in the VUG warning every time and within a few seconds - before any image coud be generated but small variations of the keyword work fine. example "High heels" fails every time but "High heel shoes" works. Similary "Toes" fails within seconds but "feet" work - at leat to the point of attempting to generate an image, then it is hit-and-miss after that.

[johnb60867848]

I see an update 24.7 (Beta) has been released.  No time to test it as yet. Hopefully this shows some improvement

[Bob5E9A]

Since the Photoshop people don't want to tell us what is going on, we can only guess. I say when PS doesn't know what to do, it gives us the violation message. It does not have a clue what "high heels" are but knows what "shoes" are. Maybe it is all about how well it is trained, not that we are creating something bad. Upon reflections that is the only answer: when it is confused you get the violation response, a cop out from Photoshop who blames us. Photoshop could make this so easy on themselves by doing what Microsoft did with the Bing image generator. Microsoft secured Dal-E as the engine. They should pay a billion to get an engine that is based on Mid-Journey. Just like the Photoshop people are not wise enough to build in an "auto, live" spell check into this board, they may not have the expertise to do what Mid Journey did, ever.

[MontyWales]

Well MidJourney used Google Safe Search for now. They have the same problems. But You can't really compaire the 2 as MJ doesn't do Outfill or Infill yet  

[Bob5E9A]

Gen fill is not that smart. Maybe some day? Who knows? Sara you said, "Maybe I select one of the fingers and ask the generative fill to create a thumb here. " Again, Gen fill is not that smart. Gen Fill has no clue how to create a thumb and know how to scale it and how to position it and blend it in.  So you get the violation. PS could give you a message saying, "Auto fill is in training and should be able to do that soon.", but the easy way out is to make it look like you did something wrong. Can someone draw a cartoon where the Auto fill programmers are laughing their heads off at a confused user when this message is sent. 🙂

[Graham24508943nobd]

Give the devil it's due, the landfill generative fills are 99% spot on as is the extending frame fill. 

Changing clothes is still very poor  though

[Bob5E9A]

montywales, re: Well MidJourney used Google Safe Search for now. They have the same problems. But, you can't really compaire the two, as MJ doesn't do Outfill or Infill, yet.  

And PS may never be able to do gen fil, as we expect. Far too difficult compared to simply just drawing a picture on a blank sheet, like MJ does. It would require MJ and PS to train itself on our picture inorder to throughly understand it, so it can create an accurate piece (a fill) that totally matches the surrounding pixels.  The only hope we have is that it can be done if we, the user, assists by inputting  what to draw, what colors to match, where to attach, scale etc. by click, click, clicking for each question it asks.

Example:

1. What to draw: We describe. It uses Chat GPT to create the prompt.

2. Colors: Click, click

3. Insert where: click, click, click.

4. What point to Connect to object: click

These are ALL variables!

And the fill can not contain background because we probably will have to resize and blend, etc.

[MontyWales]

ChatGPT sucks at making prompts  Also its only tried up to 2021. MJ has changed so much since them. 

[MontyWales]

**trained

WHY isn't there an EDIT option on this forum ? 

[Bob5E9A]

Monty Wales, 

https://www.youtube.com/watch?v=EJez32MtfWU

Everything in AI is all about training which even you can do.

[daniellei4510]

But licensing other AI technologies isn't in Adobe's long-term plan with regard to FireFly. They want to use their own database of Adobe Stock images to generate outcomes, thereby being able to pay contributors whenever parts of their images are used to create other images. At least that's my understand from what I've read from other sources.  How they can ever manage to make this work is well beyond my comprehension, but that is apparently the plan. I don't THINK that will apply to Generative Fill in Photoshop, but once it is out of beta, Adobe will start charging people to use Adobe FireFly, probably through the purchase of credits, which Adobe says will be extremely generous in terms of what they charge for those credits. 

[daniellei4510]

Yep, especially if people are involved. Text to image AI is evolving
quickly but Adobe has a long way to go to catch up with MJ and others.

[Bob5E9A]

Daniellei,

Re:But licensing other AI technologies isn't in Adobe's long-term plan with regard to FireFly. They want to use their own database of Adobe Stock images to generate outcomes...

Gaining technology fast is often about knowing your limits and acquiring technology, often through acquisitions, licencing, etc. I worked for a software company who acquired another company for $3 billion for their technology. Then we got acquired by a bigger company for our combined technology. Training on only Adobe stock would differentiate Adobe from MD. But using the best technology is a no brainer. Mary Barra just said GM will save $4oo million by using Tesla's charging technology, as will Ford.

The problem here is that no one seems to have the technology to gen fil small areas that is fully intergrated with a larger picture. 

[Sarah27914909k9u3]

Interesting theory, but in the past it has created thumbs or hands or what-have-you and done a beautiful job with it. Not every fill is a home run, but it does a great job for me when it works.

[Sarah27914909k9u3]

Here's an example for me.

I want it to generate the bottom half of this picture. Note I am not putting in ANY textual prompt at all, so there is no possibility that a bad keyword triggered the behavior. Yeah the girl here is cute, but there's nothing sexual happening. There must be a boundless number of G-PG-13 bottom halves that could have been returned.

[Sarah27914909k9u3]

Well, that's the unspoken rule for generative fill: no pretty women

[Mazter$Matyas]

without prompt it will create error, with prompt the job was done

[Sarah27914909k9u3]

THIS! If you (adobe) won't render an image on your cloud for whatever reason, let us render it ourselves on our own hardware.

[Sarah27914909k9u3]

Eh. Complaining to Adobe is our God-given right, even if it's a beta. I think you just have to keep it polite and respectful, and if you do that, then any feedback, positive or negative, is beneficial for Adobe and the community.