P: Text to Video model

Description,

it will be a good for many content creaters where they can give their idea as text and can able to generate video from the text.

it will be very useful  because lot of new and small content creators struggle to create video on their thoughts and will be helpful for movie makers to visualize their scripts as a previse

"Starting later this year, we’ll begin introducing new generative AI features for video, audio, animation and motion graphics design. In the meantime, we’d love to hear from you and learn more about what you are looking to see with Adobe Firefly and generative AI across our applications. You can sign up for the beta of Firefly and join the conversation on Discord."

Reimagining our video and audio tools with Adobe Firefly

I just saw this video which presents some really awesome features of Firefly for Video. I'd like to test this. https://youtu.be/h6tYRjE92gA (Firefly starts at 5:58)

How can I get access to the "text to video" AI? I would really like to experiment with it 🙂

Thanks & BR

Tobias

Merging your thread here so we can track the demand for certain features.

Idea to have firefly create text to video and text to audio option.

Wouldnt it be cool that you take all your photos and vids. It makes it pop and arranges with music etc 

Problem : Create beautiful videos with images / animation along with audio

Idea :

1. Take user input in form of long text (ChatGPT or similar can be used to create long text based on words)
2. Ask user to emphasize some important phrases in the long text
3. Create Images for each phrase
4.  Stitch images and suggest animations or videos
5.  Suggest audio for each video or image
6.  Select audio and video and images / animation
7.  Present different rendtions for user to select
8.  Download the selected video

Opportuinity : Short movies / clips / advertisements / story books can be created using pre-defined workflows

Example :

I am often supposed to tell stories to my kid at night (I suck big time at that). I just asked Chat GPT to create a story about an ant, elephant and tortoise. Used the highlights from the story and keyed in those in firefly.

I just realised cool capability of ChatGPT and Firefly and result was pleasing.

Story by ChatGPT:

I took some key phrases and firefly generated images:

Thanks for suggesting! Text to Video capabilities are still in exploration.