Skip to main content
Participant
September 13, 2024

Firefly just created the most egregious example of racist representation I've ever seen

  • September 13, 2024
  • 4 replies
  • 1264 views

I was testing some national stereotypes with prompts

first I've conducted experiments with AI models using prompts like 'grupo de brasileiros' (group of Brazilians) and 'grupo de brasileiros conversando' (Group of Brazilians talking). While the results were not ideal, they were not catastrophic. However, when I tried 'grupo de cubanos conversando' (group of Cubans talking), I encountered two images depicting Black men as monkeys. This is undoubtedly the most egregious example of racist bias I've encountered online.

 

I am not exaggerating the severity of this issue."

 

The images are the following. I would recomend discretion with this.

Sincerily André Holanda

4 replies

Vivek-Sharma
Community Manager
Community Manager
September 24, 2024

@Justin25301478dgti  Apologies for the inconvenience. We've shared your feedback with our product team to help improve the product and enhance your experience. Meanwhile, please use the "Report" and "Rate" options to share your feedback directly with our product team for any such images.

 

^VS

Participant
September 23, 2024

I work for a university in Australia who have a large number of First Nations students. A colleague forwarded a screen capture of an offensive result from the prompt "Australian Aboriginals" which included a monkey in the results.
I attempted the same prompt and also was supplied with another offensive image. We have First Nations learning designers who use Adobe Express to generate images for students learning materials and they could easily be exposed to these results.

This issue is being escalated in our instituion.

Vivek-Sharma
Community Manager
Community Manager
September 16, 2024

@andreholanda  Sorry for the trouble, and thank you for your valuable feedback. It will help us improve our product. We have shared your feedback with our product team, and they will take the necessary actions. Meanwhile, please try Kevin's suggestion to achieve the desired output.

^VS

Kevin Stohlmeyer
Community Expert
Community Expert
September 13, 2024

No defending the errors being generated but perhaps try specifying "men" or "people" in your prompt.

Grupo de homens cubanos conversando seems to resolve the errors.