Skip to main content
Participant
January 16, 2023
Answered

Build Plugin for Video Editing Tool

  • January 16, 2023
  • 1 reply
  • 753 views

Hello everyone!

I'm interested in developing a plugin for Adobe Premiere Pro in Javascript, but I'm very new to this process of plugin development. I need a plugin where AI/ML our case model does everything.. recognizing the face in the video, identifying lips, and modifying it to the target audio, etc. I also don't really understand how to use the SDKs and the API of Premiere Pro. Are there any guides that you would recommend to me to start?

This topic has been closed for replies.
Correct answer Bruce Bullis

The workflow you've described straddles the lines between two very distinct APIs.

PPro supports the After Effects C++ effect plug-in API, for accessing and modifying pixel data from source layers (media); AE-style effects can also access audio data. 

Changing settings of objects is handled by PPro's ExtendScript API, most commonly used from within CEP (JavaScript-based) panels. The ExtendScript API offers no access to pixel or audio data, although it can be used to drive renders to any supported format.

 

You can get to either SDK from here

 

 

1 reply

Bruce Bullis
Community Manager
Bruce BullisCommunity ManagerCorrect answer
Community Manager
January 16, 2023

The workflow you've described straddles the lines between two very distinct APIs.

PPro supports the After Effects C++ effect plug-in API, for accessing and modifying pixel data from source layers (media); AE-style effects can also access audio data. 

Changing settings of objects is handled by PPro's ExtendScript API, most commonly used from within CEP (JavaScript-based) panels. The ExtendScript API offers no access to pixel or audio data, although it can be used to drive renders to any supported format.

 

You can get to either SDK from here

 

 

Participant
May 28, 2023

It's showing three options 
1. Start Scripting - PDf Guide
2. JavaScript - github sample project
3. C++ - Says to donwload sdk and come with pdf guide and examples

 

I am new to this please guide me

Bruce Bullis
Community Manager
Community Manager
May 28, 2023

Specifics of exactly what you'd want your plug-in to do, would determine which APIs were most appropriate.

From the limited description you've provided, it sounds like you want to insert "lip" graphics (either stills or video) that correspond to audio in the source (sequence) material. Is that correct?