How to build a transcript extension for Premiere using the SDK

[NielsAAI]

I am aware that Premiere has built-in transcript capabilities, but I'm researching whether it is possible to develop and extension for Premiere that integrates with 3rd party transcript services.

Ideally, I should be able to select all audio in a timeline, or individual audio segments, and click a button to generate a transcript for it. Maybe there is a better UX for this which I'm open to exploring.

Anyway, do you think this is possible with the Premiere Pro SDK or ExtendScript or something else? Any pointers would be greatly appreciated!

[Bruce Bullis · Accepted solution]

What you're describing is definitely possible:
https://digitalanarchy.com/transcribe-video/transcriptive.html

Here's the PProPanel sample, which contains instructions on setting up a dev environment.

Here are the API docs. 

Note: There are no available APIs around PPro's (relatively) recent transcription functionality; any such APIs won't be available until after PPro has moved to UXP-based extensibility; no dates available. 

[NielsAAI]

Thank you for the quick answer! I was able to get the panel to show up in Premiere. I'll start experimenting and follow up if I run into any blockers. 🙏

[NielsAAI]

Would I use `Sequence.exportAsMediaDirect()` to get the audio? I don't see any samples on how to use the function. I need the audio data to send it to the transcription service.

[Bruce Bullis]

You're in the right example function! 🙂 Typically, extensions use app.encoder.encodeSequence() to render using AME, on the same system, in the background. 

[NielsAAI]

Thank you for all the help. It took a while to get situated in CEP development, but I got a panel that exports a sequence to mp3 and then uses an HTTP API to get an SRT for the audio file.  🙏

[Bruce Bullis]

Glad to hear it!

[sufyan38299821q01w]

can you please tell me how you are exporting audio file of sequence using extendscript code?

[Bruce Bullis]

> can you please tell me how you are exporting audio file of sequence using extendscript code?

I just answered your question, in another thread. 🙂

https://community.adobe.com/t5/premiere-pro-discussions/extendscript-how-to-export-selected-audio/m-...