P: Text to Video model

[Maurits29057514p6r1]

Please add a Text to Video model to Adobe Firefly

[Tracy.H]

Thanks for suggesting! Text to Video capabilities are still in exploration. 

[Sheldon Hatch]

One of the areas that we have been using AI image creation is virtual backgrounds for video interviews and movie scenes when we can't find the location or have to work with quick turn arounds. Looking forward to see where Adobe can take AI within it's video workflow. The video example of of the summer scene changed to winter with snow go me just a little excited where this is all going to go. Hopefully Text to video can have light movement or cars/object passing by in the backgrounds.

Here are some examples of backgrounds done so far while testing text to image of Firefly...

-s

[Karthik29193334z31e]

Problem : Create beautiful videos with images / animation along with audio

Idea :

1. Take user input in form of long text (ChatGPT or similar can be used to create long text based on words)
2. Ask user to emphasize some important phrases in the long text
3. Create Images for each phrase
4.  Stitch images and suggest animations or videos
5.  Suggest audio for each video or image
6.  Select audio and video and images / animation
7.  Present different rendtions for user to select
8.  Download the selected video

Opportuinity : Short movies / clips / advertisements / story books can be created using pre-defined workflows

Example :

I am often supposed to tell stories to my kid at night (I suck big time at that). I just asked Chat GPT to create a story about an ant, elephant and tortoise. Used the highlights from the story and keyed in those in firefly.

I just realised cool capability of ChatGPT and Firefly and result was pleasing.

Story by ChatGPT:

I took some key phrases and firefly generated images:

[Tomas29214330gyvw]

Wouldnt it be cool that you take all your photos and vids. It makes it pop and arranges with music etc 

[Pappyy]

Idea to have firefly create text to video and text to audio option.

[Tobias2684100390jy]

How can I get access to the "text to video" AI? I would really like to experiment with it 🙂

Thanks & BR

Tobias

Merging your thread here so we can track the demand for certain features.

[Tracy.H]

Thank you for the suggestion. Have you checked out our blog post?

[badde.media]

I just saw this video which presents some really awesome features of Firefly for Video. I'd like to test this. https://youtu.be/h6tYRjE92gA (Firefly starts at 5:58)

[BeauLeland]

Am I missing something, or is generative AI video capbility not yet a feature with Firefly. The original promotional video I saw (which is what led me to sign up) was all about using AI in video workflows. I received my invite today, but everything looks to be text prompts for design.  Thanks!

firefly_video.mp4

Merging your thread here so we can track the demand for certain features.

[ProDesignTools]

"Starting later this year, we’ll begin introducing new generative AI features for video, audio, animation and motion graphics design. In the meantime, we’d love to hear from you and learn more about what you are looking to see with Adobe Firefly and generative AI across our applications. You can sign up for the beta of Firefly and join the conversation on Discord."

Reimagining our video and audio tools with Adobe Firefly

[Saran30016522x7ze]

Description,

it will be a good for many content creaters where they can give their idea as text and can able to generate video from the text.

it will be very useful  because lot of new and small content creators struggle to create video on their thoughts and will be helpful for movie makers to visualize their scripts as a previse

[Patrick276656128qoo]

We're looking to create a video campaign using an AI video generator using images and text prompts that can produce specific scenarios with an AI model in real life settings based on image references. Tried Runway's video to video generator, however the outcome was not great and requires an intial video upload as the base.

[Andres300353098zbo]

I would like a text to video feature implemented on here

[Sandbwoy]

Text to video would be awesome! While there are other text-to-video generators, I like the idea of Adobe adding the feature. Judging from the quality of its images, I think text-to-video could turn out really well on Firefly!

[Shreyansh3008039008tn]

We can make even videos just writing script and and the ai will genrate video automatic according to script 

Merging your thread here so we can track the demand for certain features. You can upvote the original post to let us know you want this feature.

[Ashu30091295r0s6]

Can you create an AI who can create a AI video or movie just to give script and AI create all the movie scenes everything this is my dream that AI create a movie without using human

Merging your thread here so we can track the demand for certain features. You can upvote the original post to let us know you want this feature.

[Ghulam Hussai30128633dnq5]

basically i make a youtube video ads and i want a a video editor to make a  simple comic character  animtion tool like puppit tool 

Merging your thread here so we can track the demand for certain features. You can upvote the original post to let us know you want this feature.

[ash30356066ou4w]

Dear sir i want AI video genrater with image or photo.

[Girish30695353xpoz]

Yes I am looking also to generate video based on images and promts using Adobe, Kindly let me know if the feature is available 

[RISHABH30806274ow38]

Give me a ai tool that creates text to vedio 

[Pabusingh30810536g7yj]

Text to video

[#23]

• Should provide the feature of making a generative video using Adobe 

[Quang30972286n4hu]

Hope AI can support in video early

[Salmon309920942l7q]

You should make a text to video model! I know that probably sounds hard to make but i just wanna see it if its to hard to make Thats fine

[Mohsen31458873akc7]

Hi, please design a part in website for creating video from text.