One of the areas that we have been using AI image creation is virtual backgrounds for video interviews and movie scenes when we can't find the location or have to work with quick turn arounds. Looking forward to see where Adobe can take AI within it's video workflow. The video example of of the summer scene changed to winter with snow go me just a little excited where this is all going to go. Hopefully Text to video can have light movement or cars/object passing by in the backgrounds.
Here are some examples of backgrounds done so far while testing text to image of Firefly...
Problem : Create beautiful videos with images / animation along with audio
Idea :
Take user input in form of long text (ChatGPT or similar can be used to create long text based on words)
Ask user to emphasize some important phrases in the long text
Create Images for each phrase
Stitch images and suggest animations or videos
Suggest audio for each video or image
Select audio and video and images / animation
Present different rendtions for user to select
Download the selected video
Opportuinity : Short movies / clips / advertisements / story books can be created using pre-defined workflows
Example :
I am often supposed to tell stories to my kid at night (I suck big time at that). I just asked Chat GPT to create a story about an ant, elephant and tortoise. Used the highlights from the story and keyed in those in firefly.
I just realised cool capability of ChatGPT and Firefly and result was pleasing.
Story by ChatGPT:
I took some key phrases and firefly generated images:
I just saw this video which presents some really awesome features of Firefly for Video. I'd like to test this. https://youtu.be/h6tYRjE92gA (Firefly starts at 5:58)
Am I missing something, or is generative AI video capbility not yet a feature with Firefly. The original promotional video I saw (which is what led me to sign up) was all about using AI in video workflows. I received my invite today, but everything looks to be text prompts for design. Thanks!
"Starting later this year, we’ll begin introducing new generative AI features for video, audio, animation and motion graphics design. In the meantime, we’d love to hear from you and learn more about what you are looking to see with Adobe Firefly and generative AI across our applications. You can sign up for the beta of Firefly and join the conversation on Discord."
it will be a good for many content creaters where they can give their idea as text and can able to generate video from the text.
it will be very useful because lot of new and small content creators struggle to create video on their thoughts and will be helpful for movie makers to visualize their scripts as a previse
We're looking to create a video campaign using an AI video generator using images and text prompts that can produce specific scenarios with an AI model in real life settings based on image references. Tried Runway's video to video generator, however the outcome was not great and requires an intial video upload as the base.
Text to video would be awesome! While there are other text-to-video generators, I like the idea of Adobe adding the feature. Judging from the quality of its images, I think text-to-video could turn out really well on Firefly!
Can you create an AI who can create a AI video or movie just to give script and AI create all the movie scenes everything this is my dream that AI create a movie without using human
Merging your thread here so we can track the demand for certain features. You can upvote the original post to let us know you want this feature.
34
Replies
AdChoices