P: Generated images violate user guidelines

[Hematita]

So as you can see, it's a PG-13 relatively inoffensive image of a woman in a bunny outfit. The top worked fine, and I was able to complete the top ear, which is cool. When I tried to extend the bottom with generative fill, though, I got this warning. They're just a pair of legs wearing stockings, and I wanted to extend it.

It feels like a false flag - though I could be wrong? I find myself thinking it would do the same for women in swimsuits.

Figured I'd share here.

[Graham24508943nobd]

This is MY first attempt at a selfie generation. The lady needs major dental work 😆😆

[Graham24508943nobd]

My 2nd attempt at a selfie pose...The background was a plain white so I changed that to a tropical beach, changed her clothes to summerware, ( bikini and swimwear violate user guidelines ).

 

[Graham24508943nobd]

I tried adding a broach to her dress and it violeted user guidelines. This is feckin crazy

[Graham24508943nobd]

Not just bikini but swimwear ??????    Jeeez.   Oh AND Broach

[Graham24508943nobd]

Did another selfie generation and tried to extend the frame. Guess what ?.....Adome violated their OWN user guidelines.  😅😅😅.  

[Bob5E9A]

Thank you Alexander! I will work with your approach. 

How this relates to my world...children's book. With Mid Journey I can create a character and even mutiple images of that character, walking, running etc. But the images are fixed. Can't bend the elbow so the rabbit can hold an ice cream cone (cone is separately generated). I will use your method to try to get limbs to adjust.

[Graham24508943nobd]

For THIS pic I typed posing in the prompt box. Got this beauty. She was in a plain blue background and I swapped to a movie studio. Next the dress was changed. Her eyes were brown so I changed to blue. Her nose was a bit disfigured so I gave her a new one, I added a pendant to her dress and finally sorted a blemish that was on her top lip using the spot healer. Oh I also changed her hairstyle.   I'm pretty pleased with the result

[Bob5E9A]

Graham,

5 stars !

🙂

[MontyWales]

Must be an American thing, I don't know.

Well they ban books so no suprise 🙂

[Vito27662922on8d]

Curiously, I've had problems with "bikini" but not swimwear or swimsuit.

So I ask for two piece swimsuit, sometimes it'll give me the Violation,

but if I spell "piece" incorrectly as "peice" it will do it.

[Graham24508943nobd]

Being a huge sci-fi fan I gave her a Trekkie style makeover. She'd be a perfect female Data 

[MuNAf]

Good for you. For me even tree brunch violating the user policy of adobe. Grass - Violation, Wood- Violation; Rock - Violation. It feels like the AI kind of pervert. It sees di.ks everywhere. 

[LiveAndLetLive]

Thank you. I'm happy to see that most people seem to understand the danger in forced censorship based on someone elses ideas of morality. 

[LiveAndLetLive]

Couldn't agree more - though I also understand why these companies fear bad press from people making things with their tools that goad the general public into crying for more top-down control. 

I'm sure things will begin to balance out a bit more once some of the 'hubbub' around AI tools and the ethics surrounding them calms down as people begin to realize they are still just 'tools' and point their fingers at people who misuse them instead. 

I'm a libertarian at heart and believe that so long as people are in the comfort and sanctity of their own personal domain they should be allowed to do anything aside from harming others - but unfortunately there are a great deal of projectionists (in the psychological sense) out there who would seek to avoid a glimpse in the mirror by shouting at everyone else's reflection instead. 

[LiveAndLetLive]

Image detection algorithms are funny things and can be quite unpredictable until they really get dialed-in, and that takes some tweaking and time. 
Just look at Stable Diffusion and how their first couple 'censored' models also resulted in a drastic reduction in general usability = they turned an amazing tool into absolute caca while trying to keep the thought police happy; thankfully they also allowed people to train their models so they could produce whatever the heck they wanted, which was something much more in alignment with their original ethos. 

Depending on the dataset and how the model was trained, any keywords having to do with areas of the human body that are also frequenly shown in naughty ways can unwittingly create similar images - in which case the detection algos kick in and do their work. 

What Adobe should be doing is allowing people the same as what Emad's team (et al) did in allowing people to apply finetunes to the model, which puts the majority of the questions regarding responsible use and ethicality back on the users and idemnifying them from what others create. 

There will still almost certainly be the dreaded "Look what _AdobeProduct_ let me make" here and there, but at least people would know by and large that it wouldn't be possible without the individual training it that way.

[Bob5E9A]

Today I saw the future. Actually I saw a red truck Mid Journey produced a few months ago. Trash. Then a picture of a MJ red truck today. Completely amazing. Very fast, brilliant evolution.

My crystal ball says that in less than 2 years, we will use specialized prompt software to generate an object (person, animal, cartoon, alien, etc.) in 2d (similar to today). Once we approve of the character, click a button to submit the drawing to be rendered in 3D. Every limb joint (or micro point like around the eyes and lips) will have a pivot point. We can move every element of the 3d model and create a pose. Then we click for a snap shot and add those images to other images to create art for ads, children's books, comic books, regular art, etc.

This is similar to what the Nvidia CEO demonstrated as the future for designing factory production systems with their new computers. The concept is like fast regeneration in video games. So nothing really new, just AI to facilitate user created graphics. (The 3d object might be a wire structure until we click, "Render" to render a 2d image.

[NCARalph]

I was attempting to fill a window in an image with this prompt and got a violation notice:

Dark backlit head and torso of a man

[daniellei4510]

Everyone is sayihg AI will put professional photographers out of business. It won't. They will adapt and use AI to their advantage. Amateur photographers will keep doing what they're doing because it's a hobby, not a business, and AI means nothing to them. It will, however, put professional or wanna-be professioanl models out of business. At least to a point. There will always be exceptions, not to mention legal issues when it comes to using likenesses of well-known actors, models, or trying to pass AI off as a real photograph of a real person. We won't be seeing an AI version of the Sports Illustrated swimsuit edition any time soon. In any case, t's going to get very interesting for sure.

[Graham24508943nobd]

I've had loads of violation errors using BLANK prompts, and more than a few working on their OWN generated image

[daniellei4510]

First time, huh? I've gotten it about three times. Worked eventually a couple minutes or less later. Just think of it as zipper merging on the on-ramp during highway or bridge construction. 

[Davi260969189pzw]

you probably already know about this but 90 percent of the time generative fill returns a warning saying that it wont work as the generated image violates user guidelines... this is for all photos including grass and trees as well as baby photos and portraits 

[Graham24508943nobd]

Meet Galaxina, my latest creation. Her nose, face & hair are the only original parts left. Her mouth was horribly distorted, so it took ages to find a nice one. I gave her kinder eyes and changed their colour. Costume took a while to find but it was worth the wait, I also added the pearls and changed the background to sky. Loving playing about with this......  This has taken me 3 hours as only one out of 6 generations were usable. 

 

[Kevin Stohlmeyer]

Hi @Davi260969189pzw yes this has been well documented in this forum. Try entering a basic prompt and see if you still get a failure.

[Bob5E9A]

Alexander,

Regarding, the high demand message.

Watched a video of a person who asked questions to the CEO of Mid Journey. She asked why don't they advertise and why do they stay so low keyed?

The message was that if MJ user count grew as fast as the "hottest" Internet apps grew in the past, that the world would not have the computing power to support their growth.

Hence why the Nvidia stock prices zoomed up.

Does PS have the computing power in its Cloud, probably not. Can Nvidia supply its computer fast enough?

Will we have to pay for these new computers? Of course.

[Davi260969189pzw]

quiet a lot of the time that helps but most of the results when a prompt is entered arent usable...