Now in Premiere Pro (beta), AI-powered Media Intelligence automatically identifies visuals such as people, objects, location, camera angles, and more across thousands of clips in seconds. With the new Search panel, use natural language to find these visuals, plus spoken words in transcripts or clips with embedded metadata like shoot date, location, or camera type – all at the same time. The media intelligence analysis is faster than real time and runs locally on your computer, there is no internet connection required. Your media and searches are never used to train Adobe’s AI models. This new search can help you at any stage of your edit, whether you’re diving into organizing hours of new footage, or you need to quickly find that one shot you know you’ve seen before. How to get started: Import your footage into a new project or open an existing project. Open the Search panel by clicking the magnifying glass button in the upper right corner of Premiere Pro app or under Window > Search. Let the background analysis process finish. When the analysis is finished you should see ‘Visual analysis complete’ in the Search panel. Type in the search field. Visual search can give better results the more specific you are in describing the scene. How media intelligence visual search works: Premiere Pro analyzes your footage using on-device models. You have settings to control caching of the analysis. You can turn off analysis altogether in Preferences > Media Analysis & Transcription. The analysis from each clip is collected into an index for your project. You’ll see this as a new .prin file next to your project file. When you type into the Search panel, your text is analyzed by the same models and then compared against all the analysis collected in the index to find the best semantic matches. Read more about Media Intelligence search and check out the Frequently Asked Questions. While Search panel is in beta your feedback is invaluable – please give it a try and share how it went for you: what worked, what needs work, and what you’d like to see us do next with media intelligence. Once you’ve tried out the new search, let us know what you think in this short survey: https://forms.office.com/r/r0nxuQkPZH – Thank you!

Community Manager

Question

[Now Released]: Search panel finds the shot faster with visual search

Forum|Forum|1 year ago
December 16, 2024
19 replies
20483 views

Now in Premiere Pro (beta), AI-powered Media Intelligence automatically identifies visuals such as people, objects, location, camera angles, and more across thousands of clips in seconds. With the new Search panel, use natural language to find these visuals, plus spoken words in transcripts or clips with embedded metadata like shoot date, location, or camera type – all at the same time. The media intelligence analysis is faster than real time and runs locally on your computer, there is no internet connection required. Your media and searches are never used to train Adobe’s AI models.

This new search can help you at any stage of your edit, whether you’re diving into organizing hours of new footage, or you need to quickly find that one shot you know you’ve seen before.

How to get started:

Import your footage into a new project or open an existing project.
Open the Search panel by clicking the magnifying glass button in the upper right corner of Premiere Pro app or under Window > Search.
Let the background analysis process finish. When the analysis is finished you should see ‘Visual analysis complete’ in the Search panel.
Type in the search field. Visual search can give better results the more specific you are in describing the scene.

How media intelligence visual search works:

Premiere Pro analyzes your footage using on-device models. You have settings to control caching of the analysis. You can turn off analysis altogether in Preferences > Media Analysis & Transcription.
The analysis from each clip is collected into an index for your project. You’ll see this as a new .prin file next to your project file.
When you type into the Search panel, your text is analyzed by the same models and then compared against all the analysis collected in the index to find the best semantic matches.

Read more about Media Intelligence search and check out the Frequently Asked Questions.

While Search panel is in beta your feedback is invaluable – please give it a try and share how it went for you: what worked, what needs work, and what you’d like to see us do next with media intelligence.

Once you’ve tried out the new search, let us know what you think in this short survey: https://forms.office.com/r/r0nxuQkPZH – Thank you!

D

defaulttkzxpkcyj7x9

Participant

It would be really great if there were an option in the Search window to 'exclude previous results' or something that could only show moments of clips that I haven't already pulled / added to a timeline. My current workflow is basically pulling hundreds of results down to a selects stringout, and then weeding out the most relevant results from there...but because I'm often getting the same moments of a clip as a result of different search terms, I'm getting lots of duplicate frame repeats. The search results are (understandably) still very broad.

An even better feature add for Premiere in general would be a way to delete all duplicate frames from a given timeline. This would solve my specific issue / save me the time manually deleting duplicates.

Overall this feature is awesome- very useful when you have mountains of footage. Can't wait to see it released in full

P

Porfirio18771911

Participant

This needs the ability to index a specific bin in the project so it does not necessarily need to index all file. Should also be able to search a specific bin. Would be very helpful and would save a ton of time.

mattchristensen

Community Manager

@Porfirio18771911 I agree, searching only a specific bin would be useful. Thanks for the feedback.

novian

Participant

Oh is it possible to search on specific sequence?
because I have many sequences like backup seq, assembly seq, etc. and when I search the result comes out for all sequences, even though I only want to search from a specific sequence.

P

Porfirio18771911

Participant

Did something as simple as "frame where subject's eyes are looking at camera" and it gave me everything but a frame where the subject's eyes were looking at camera. Is there a lexicon somewhere for this search feature?

mattchristensen

Community Manager

@Porfirio18771911 There is no specific lexicon. Keep in mind that "eyes are looking at a camera" could also describe looking at a camera in the shot. Sometimes extraneous words like "frame where" can confuse things. I would be curious to know if other searches like "eyes looking forward" or "eyes looking" or "close up eyes" might find your shot?

A

AndyAndyAndy

Participating Frequently

This looks great!! I really hope there are plans to extend the global search interface to include results from manually added labels and markers. I'd also like the option to ONLY search for user-added identifiers.

Then please refine the interface for addding labels / markers so we can select clip ranges, add notes and keywords;

- using only the keyboard.

- without stopping playback.

The closest we've had to this is the long-dead Prelude. I miss it every day.

Finally (!) Can we have Production-wide search? This would be amazing for documentary.

MyerPj

Community Expert

I'm with Andy, ah... Andy, er...Andy on this. Especially the productions. I do miss Prelude.

I have something good to report on this search: I've got a bunch of clips of birds, (my own stuff, not for a client), so it's not documented as well as it could be... :-), But I put in my first search, 'many birds sitting on a wrought Iron fence' and wow, it found the exact clips I was looking for, and very quickly.

So, thank you very much, this is a cool new feature! 🙂

P

Piotr Gardecki

Known Participant

I made a first attempt, imported photos instead of videos, so as not to overload the system. The engine read everything and indeed then I could search for people or a street and create a sequence from them on the timeline.

cgrado

Participant

Is there a plan to return only parts of clips in the search results, or at least a timecode reference? I have hours of dance competition footage to look through, and getting the result for "person spinning" as almost every single clip (generally 30-90s long) isn't very useful. Instead I would like it to return a clip (since premiere is non-destructive and just points to sources anyways), that points only to the section of the media during which that action is happening.

Alexander Riss

Adobe Employee

Thank you for your feedback. The search already tries to split each clip into sections of similar content. If you search, you should already get the part that the engine considers very siminar.

Depending on you camera distance, details about the movement of the person might be too small for the ai to pick up as we only look at a thumbnail sized version of each scene for performance reasons

theok8577996

Inspiring

I tested with some footage with interviews and close up shots of people.

"Interview" does not give good results, while that should be easy to detect with clip length and close up angle

Also "Close -up" does not seem to work or "close up people"

Alexander_DVA

Adobe Employee

Thank you for your feedback! The search works best the more details you use to describe a scene and generally has its lowest precision if using a single word for searching. E.g. instead of "interview" , a search for "person speaking into the camera" should return better results. We are aware that this is very different from what people are used to searching when e.g using regular search engines - but it also comes with a much stronger power of expression.

Best regards,
Alexander

MyerPj

Community Expert

Oh, thank you! I like it. 🙂

yanga18281014

Participant

I was thinking - wouldn't it be awesome if AI could help us quickly flag problematic shots in our footage? Like, when you've got multiple takes of the same scene, the AI could automatically identify which ones have camera shake or when something accidentally blocks the frame. Maybe it could use color coding to highlight the best takes among similar shots. This would be a huge time-saver for video editors when they're looking for the perfect clip to use

G

Grant34943213rnh0

Participant

Hi Jessica, are there any demo videos showing the process? And secondly, will it be possible to search an entire footage library on a local drive/NAS (rather than only imported clips)?

Alexander_DVA

Adobe Employee

Thank you for your feedback.

Currently you can only search clips in your currently open projects. What you can do is e.g. use AME to analyzer all your clips up front, and then add them to your projects, so you can start searching them immediately.

Best regards,
Alexander

G

Grant34943213rnh0

Participant

Thanks. In order for it to be far more useful in a professional use case, it would need to be able to search and filter the results of an entire footage library, typically stored on a NAS.

Show more replies

Sign up

To post, reply, or follow discussions, please sign in with your Adobe ID.

Sign in to Adobe Community

To post, reply, or follow discussions, please sign in with your Adobe ID.

Scanning file for viruses.

This file cannot be downloaded