Skip to main content
Participant
May 23, 2023

P: Generated images violate user guidelines

 

So as you can see, it's a PG-13 relatively inoffensive image of a woman in a bunny outfit. The top worked fine, and I was able to complete the top ear, which is cool. When I tried to extend the bottom with generative fill, though, I got this warning. They're just a pair of legs wearing stockings, and I wanted to extend it.

It feels like a false flag - though I could be wrong? I find myself thinking it would do the same for women in swimsuits.

Figured I'd share here.

1085 replies

Kevin Stohlmeyer
Community Expert
Community Expert
June 5, 2023

Hi @Cwer34 have you tried entering a prompt? The error isnt necessarily due to restrictions, but a bug in the beta.

Participant
June 5, 2023

Stop the patronizing and let people create their ideas. I always get "Violation of user guidelines" when i want to replace or change clothing of any human. This is idiotic and i wont buy the new Photoshop if this nanny idiocy persists. The "Violation of user guidelines" should be eliminated completely. Free design for free people. And we have paid >25 per month for Photoshop, (I not yet-still in the 7 days trial mode, but i wont buy/prolong the sub if this "violation...stupid popup" persists, because this is a showstopper and makes the new AI feature useless.

Participant
June 5, 2023

Stop the patronizing and let people create their ideas. I always get "Violation of user guidelines" when i want to replace clothing of any human. This is idiotic and i wont buy the new Photoshop if this nanny idocy persists. 

Kevin Stohlmeyer
Community Expert
Community Expert
June 5, 2023

Hi @Cwer34 are you entering a prompt?

Graham24508943nobd
Known Participant
June 5, 2023

Generated a photo, of myself and left the prompt blank. How in the hell did a sign I was holding end in in a foreign language ?

Photoshake
Known Participant
June 5, 2023
quoteHmm.. so I if I use AI to create a "nude" image of someone (suppose only leaving someone's head...) then is it really that person?  No. It's something that doesn't even exist in reality. It's artificial. 

So I quickly googled deepfake law and in the UK where I am, it is illegal and in certain US states it is illegal with more trying to pass bills to tackle it. I have the skills to create a deepfakes without AI, but AI is making this accessible to many more people! Also based on your logic, if I took your headshot and posted it on a nude site with an AI-generated body, you'd be okay with it because it is 'artificial'? 

To see how damaging this is to those who are affected, just look up The Atrioc deepfake controversy" where twitch streamers were in pornographic video's and images that mix their face with AI. 

quoteYou're going down an entire other road regarding "intent." Which is another completely diffrent argument... Should knives be banned in restaurants? 


These are not analogous, a knife crime is unlikely to occur in a place with families and CCTV. Knife crime is usually opportunistic and pre-meditated. It is rarely done in a public place. Also unless you're in a steak restaurant the knives on the table are not likely to cause much harm. 

 

As stated before, I agree that the guidelines are too strict, but your examples do not help here because they show exactly why they are needed - to prevent misuse that could cause harm to an individual or a group! 

Mike Cassidy
Participant
June 5, 2023

Hmm.. so I if I use AI to create a "nude" image of someone (suppose only leaving someone's head...) then is it really that person?  No. It's something that doesn't even exist in reality. It's artificial. (Not to mention people have been able to do such things now since applications such as Photoshop have been available to the public for decades-- although this may make it somewhat easier.) Ethically, it may be wrong to use such an image to damage someone--- which is another thing altogether. You're going down an entire other road regarding "intent." Which is another completely diffrent argument... Should knives be banned in restaurants?  Do you realize that millions of times a day people walk into restaurants and knives are just sitting around on tables!!??  Do you realize the "danger" here?  People could walk into a restaurant and grab one and wreak havoc.  Should restaurants be banned?  😀

Photoshake
Known Participant
June 5, 2023

@Mike Cassidy whilst I agree to a point, it is a fine line they have to tread. 

If you have a female model who didn't want to shoot nudity (or even male) and you use AI to generate a nude image of them, that is very unethical and potentially illegal. So Adobe absolutely should be restrictive on what you can create. Especially as there will be some bad actors who use it where the subject is a minor. So I disagree it should be unrestricted and we have free reign, my arguments are that they are currently too strict. 

However, by putting these restrictions in place they are affecting what can be created. 

I was creating some quick avatars for a game of D&D and even "cartoon daggers" were prohibited. Despite fantasy images being harmless. 

Known Participant
June 5, 2023

We are not all Americans . 

Participating Frequently
June 5, 2023

Hello all,

On this example Adobe did a pretty good job to generate fill on top and left side of my original image.

But as soon as legs are involved, (or any part of human skin, it seems) the censorship algorithm is blocking the process.

I've read that there were ways to go around the low-res (1024x1024px) of the generated fills by selecting smaller parts of the images. But do you know any ways to go around this abusive guidelines-blocking process ?

Kevin Stohlmeyer
Community Expert
Community Expert
June 5, 2023

Hi @Frederick30153564odsl first - the guidelines are not abusive. Second, it has been noted heavily in this forum that generating without a prompt can cause this issue - it has nothing to do with the subject. Try entering a simple prompt like "extend legs" and see if it errors.

daniellei4510
Community Expert
Community Expert
June 5, 2023

Oh, please, don't bring politics or the constitution into this. It's a freaking bug. Chill. Adobe can ban or allow whatever they want. You should try Midjourney, where words like pixie, blood, transparent, sex, guns, Afghan and hundreds of other words are banned. 

Adobe Community Expert | If you can't fix it, hide it; if you can't hide it, delete it.
Participant
June 5, 2023

Unable to edit out this line on a black and white photo on a males arm

 

 

Why is this a breach of the guidelines?