Skip to main content
Inspiring
October 27, 2023

Firefly can't count

  • October 27, 2023
  • 25 replies
  • 4154 views

Why can't Firefly count? It's been over a year with hundreds of complaints about how Firefly can't count. Is counting really all that hard?
Another attempt... I typed "eight wheeled car" and EVERY image was a four wheeled car. Over and over again. Firefly couldn't grasp a car with more than four wheels. So, I tried fewer than four. I typed in "one wheeled car" and it gave me four-wheeled cars again.

I tried a different approach. I typed in "eight birds". It gave me six.

Seriously, why can't Firefly count?

25 replies

Inspiring
January 15, 2024

I read it and re-read it. That's why I asked. Clarification. 🙂
It sounds like you're saying the developers of AI don't consider counting to be important. Why is that? In addition to the many other ways we see the world, we humans see the world and analyze it through numbers and we consider that incredibly important. Would you be able to help me understand why counting isn't important in AI development? (Genuine question. Trying to learn as much as I can so I understand it all better.) Thanks.

Inspiring
January 15, 2024

That article might give me some insight. I'll take a look. Thank you. 
All I really want is to understand why AI can't count. It's frustrating when it can create incredibly realistic and artistic images of landscapes and animals and people doing so much, but can't give me the correct number of items.
If I understand "why" AI can't count, I might not get so frustrated when creating things that require counting. 

jane-e
Community Expert
Community Expert
January 15, 2024
quote

Why can't Firefly count?

By @holtwebbart

 

 

I expect a rebuttal, but I found this for you anyway. It doesn't mention Firefly — only three other Generative AI tools that can't count.

 

https://theconversation.com/if-ai-image-generators-are-so-smart-why-do-they-struggle-to-write-and-count-208485

"Generative AI tools such as Midjourney, Stable Diffusion and DALL-E 2 have astounded us with their ability to produce remarkable images in a matter of seconds. Despite their achievements, however, there remains a puzzling disparity between what AI image generators can produce and what we can. For instance, these tools often won’t deliver satisfactory results for seemingly simple tasks such as counting objects and producing accurate text."

(italics mine)

 

 

If you are not happy with Generative AI, you can always use traditional methods in Photoshop and Illustrator to composite your image. Or you can wait for it to get better. It's learning all the time.

 

 

Jane

 

Monika Gause
Community Expert
Community Expert
January 15, 2024
quote

Monika Gause, are you saying that quantity isn't important?


By @holtwebbart

 

I think you need to re-read my post.

 

Counting was obviously not a thing in the training of the generative AI. There is no documentation about what those gen AI models do on the inside and how they work. But counting obviously is something they did not learn. None of them. It's not how they see the world or analyze things.

Inspiring
January 15, 2024

This is an image of "six monkeys winning money at casino". 

Inspiring
January 15, 2024

I'm sorry if this response pops up twice. My page crashed right after posting and I don't see my latest reply...

Monika Gause, are you saying that quantity isn't important?
So, if I (hypothetically) have a client who wants an image with eight birds and Firefly will only give me six birds, that should be good enough and I can add the rest of the birds myself?

Monika Gause
Community Expert
Community Expert
January 15, 2024
quote

How did that unrelated response get so many upvotes?


By @holtwebbart

 

I do not know. Probably because it is not unrelated.

 

The exact number of things played no role in the "learning" of the AI (generally obviously, it's not only Firefly). It does not count things. It has no relation to counting. 

 

Most of the time when you photograph a car you do not even see 4 wheels. You see 2 wheels, sometimes 3. The AI doesn't even know that.

 

If you want more wheels, use the background replacement, mark the place where you want a wheel and have it generate the wheel.

Inspiring
January 15, 2024

Of course I did, Jane. Watched the entire video (though I don't think the people upvoting your post have watched it). It says the number of freckles isn't important. Does that mean the number of wheels on a car is unimportant? Does that mean the number of birds I asked for is unimportant? What if the number IS important?

jane-e
Community Expert
Community Expert
January 15, 2024

 

@holtwebbart wrote: Do you have a video explaining why Firefly can't *count*?

 

 

Did you watch the part where he asked for five freckles?

 

Jane

 

Inspiring
January 15, 2024

Okay, Jane-e... Did anyone get hurt? No. good.

One post was in the "bugs" section, one in the "community" section. Two different groups where I was hoping to get two different responses. Like telling the city there is a pothole on your street and also telling your neighbors.