Firefly Model Compliance Failure Resulting in Credit Loss
- December 19, 2025
- 1 reply
- 231 views
Product: Adobe Firefly
Model: Firefly (with Gemini)
Issue Type: Critical generation error / repeated instruction failure
Credits Lost: ~240 credits
Description of the Issue
I experienced a reproducible and persistent generation failure while attempting to create a clean Supplement Facts label from scratch.
Despite providing:
Extremely detailed, step-by-step instructions
Explicit constraints (delete Arabic text, do NOT duplicate columns, exact ingredient list and quantities)
Multiple retries with refined prompts
Firefly repeatedly:
Duplicated ingredient columns
Repeated ingredient concentrations incorrectly
Ignored instructions to remove Arabic-language cells
Renamed the label incorrectly (e.g., “Active Ingredients” instead of “Supplement Facts”)
Altered structure despite explicit layout specifications
This occurred across many consecutive generations, consuming credits without producing usable output.
Why This Is a Bug (Not User Error)
Instructions were explicit, deterministic, and unambiguous
The task is structural text layout, not creative ambiguity
Errors were consistent and repeated, even after corrections
The model failed to respect hard constraints (column deletion, no duplication)
This indicates a model compliance failure, not a prompt quality issue.
Impact
~240 Firefly credits consumed
No usable asset produced
Significant time lost correcting repeated generation defects
Requested Resolution
Refund or restore consumed credits (~240)
Flag this as a layout-generation compliance bug
Improve constraint handling for structured documents (labels, tables)
Additional Notes
The final label was only achievable after abandoning Firefly and manually correcting output, confirming the failure was systemic.