Skip to main content
Participant
May 23, 2023

P: Generated images violate user guidelines

 

So as you can see, it's a PG-13 relatively inoffensive image of a woman in a bunny outfit. The top worked fine, and I was able to complete the top ear, which is cool. When I tried to extend the bottom with generative fill, though, I got this warning. They're just a pair of legs wearing stockings, and I wanted to extend it.

It feels like a false flag - though I could be wrong? I find myself thinking it would do the same for women in swimsuits.

Figured I'd share here.

1084 replies

joee1020930
Participant
August 29, 2023

If you try to use generative AI with 'Elk' as a prompt, it will trigger the "this violates guidelines..." warning. This happens 100% of the time for me. 

Inspiring
August 28, 2023

I updated this morning to the new version of Photoshop Beta 25.1. A  new alert now pops up when the  generated  image seemingly conflicts with the guidelines. We can now "request a review". I have not seen this before. See the image attached.

Caity.psd
Community Manager
Community Manager
August 28, 2023

@JULIO CESAR HERRERA PEÑA what is the selection you are making or trying to add or remove?

 

I tested with the latest 25.1 build (release today) and had no issues.

 

Thank you,

Caity

Participant
August 28, 2023

LAS FOTOGRAFIAS DE PERSONAS AL HACER RELLENO GENERATIVO CONTINUAMENTE ME MANDA EL MENSAJE DE QUE VIOLA LAS NORMAS COMO SI FUERA UNA FOTOGRAFIA CON POCA ROPA ME IMAGINO Y NADA QUE VER ES FRUSTRANTE.  ADJUNTO LA IMAGEN SOBRE LA CUAL ME MANDA EL MENSAJE 

Participating Frequently
August 28, 2023

misogyny

Participant
August 28, 2023

I find that 90% of images that have an above average amount of skin showing gets flagged...  I am a fashion and glamour photographer and this tool is pretty much usless to me... it is to bad because it would save me time in certain situations.

Participating Frequently
August 28, 2023

This is how I think it works. It's a two tier system, first is a keyword system. It's somehwta intelligent for an example allows swimsuit and woman but not woman in swimsuit, it gets a lot more restivtive soon as it catches a female pronoun or anything that identifies the subject as a woman.

The second layer is it generates the outputs and scans them, my guess is they use a pcuture interpretor AI for this, turning it back into text and then it goes back into the same keyword system as the first layer.
I would guess that if there is a prompt only the returned layer is scanned, if there is no prompt the entire picture is scanned. No idea why.

Participating Frequently
August 28, 2023

If it indentifies a woman in the picture generative fill with no prompt considers everyhing in breach of the user guidelines.

 

joee1020930
Participant
August 28, 2023

If you try to use generative AI with 'Elk' as a prompt, it will trigger the "this violates guidelines..." warning. This happens 100% of the time for me. 

Participant
August 28, 2023

Photoshop: Using generative expand:
Image is flagged as violating safe use guidelines when it clearly is not.