Skip to main content
Participant
February 13, 2025
Open for Voting

Enable Firefly to follow instructions that change where 2D artwork subjects are facing/gazing.

  • February 13, 2025
  • 0 replies
  • 43 views

Maybe I am just new to using generative text-to-image tools. Still, It turns out that getting Firefly (or DALL-E, and several others I tried) to pay attention to and follow instructions that specify or adjust the direction in which a 2D artwork subject is oriented/is facing/is gazing. This may be easier to accomplish with photography subjects, with better face detection in photos.

 

Not so for cartoon bunnies staring dramatically in the wrong direction. 

It was particularly difficult (as in tens of hours of trial and error) to get Firefly to reposition a small, AI-generated drawing of a bunny (attached) with a yaw of about 45 degrees (45 degrees counterclockwise away from the viewer) to face in any other direction.  Even more frustrating,  bunny's position was such that his left eye was completely obscured due to the shape and position of his head, and it took hours of trial and error--and frustrated attempts at using puppet warp, liquefy, free transform, etc.--for Firefly to draw even one remotely similar bunny with two visible eyes when the original was used as a style or composition reference.

I'm curious to see if I can use the new text-to-video feature to get stills of videos where my 2D subjects do nothing but turn from one side to another, but that seems awfully impractical (not to mention costly). If Firefly were to get this working, it would be incredibly valuable to me. 

 

-Jason
San Francisco, CA