Skip to main content
Participant
March 31, 2023
Question

AI based sreenplay to Storyboard

  • March 31, 2023
  • 4 replies
  • 6734 views

Hello Adobe world, 

 

This isn't Premiere specific, but it relates to video content creators and would integrate with Premiere. (and I didn't know where else to put it!)

 

I was inspired by the new Firefly beta release and started dreaming of possibilities.

 

Please make an AI-powered screenplay-to-storyboard app. 

 

Based on what FIREFLY can already do, it doesn't seem like much of a stretch to take an entire screenplay and generate storyboards. The AI would notate locations, time of day, characters, shots (WIDE, ECU, etc.) and other framing notes-- heck, based on what Premiere and AE can do, you should even be able to specify the camera you are using, lens choice, aperture, etc. The AI will then create full storyboards or slide presentations based on the text descriptions and technical notations.  You could then import into Premiere and the slides could act as placeholders/scaffolding to be replaced when the full video or artwork is created. 

 

I could even see camera movements as simple animated features. DOLLY IN, PAN RIGHT TO REVEAL etc. 

 

A lot of smaller projects don't storyboard because of the time or expense. With the AI generating them quickly and affordably, it would save so much wasted time/money and prevent a lot of production mistakes before they happen.

 

Make it so.

This topic has been closed for replies.

4 replies

Participant
October 3, 2023

Converting an Adobe AI-based screenplay to a storyboard can be challenging due to the following difficulties:

Interpretation: AI may not capture nuanced emotions, expressions, or actions accurately, requiring human interpretation.

Visual Representation: Adapting text to visual scenes may result in creative gaps or misalignment.

Detail Complexity: Complex scenes may need manual adjustment, as AI may struggle with intricate descriptions.

Character Design: AI may not handle character appearances and characteristics well, necessitating manual input.

Dialogue Flow: Ensuring natural dialogue transitions from script to storyboard may be challenging for AI.

Feedback: Collaboration and feedback with human artists may be crucial for quality storyboarding.

Participant
July 25, 2023

Pleeeeease make this happen!

Participant
June 27, 2023

100% agree! As a content creator and filmmaker I am so excited for this release!

Ann Bens
Community Expert
Community Expert
March 31, 2023

Moved to Video Lounge.