Premiere Pro Transcription Not Identifying Separate Voices

Report · May 22, 2023

I've been using the auto-transcription tool a lot lately, and the update makes the interface look better but now the separate speakers are not being identified.I have "Show Speakers" selected and I also went through the extra step of clicking "Generate Static Transcript" under which you can select "Separate Speakers." The only speaker being shown in the generated transcript is "Unknown." If I change the name of this Speaker, it changes every line to that speaker.

Report · May 22, 2023

"Unknown" either means you had the setting to identify speakers disabled or the AI model can't clearly hear the speakers and tell them apart. You should see "Speaker 1", "Speaker 2" etc. Try re-transcribing your source clips.

Be sure you are in the Tect-based editing workspace - Window > Workspaces > Text-based editing
Find the source clip in the project panel and load it into the source monitor by double clicking
In the text panel, make sure you are on the "Transcript" tab. Choose "Re transcribe" from the overflow menu (three dots)
Make sure to check the option to separate speakers
Is the audio recording clear? Are the different speakers clearly audible and have different-sounding voices? Sometimes voices that sound similar get lumped together. If all else fails, you can identify the speakers manually.

Report · May 24, 2023

I'm getting the same issue.

According to Francis's reply, "Be sure you are in the Tect-based editing workspace - Window > Workspaces > Text-based editing"

Now, I'll do that, but not sure why it should make a differene. If I activate the "text" window in general I feel like I should be able to do what I want within my customized workspace... but, we'll follow the directions and see what shakes out.

Report · May 24, 2023

@gabbic0104 @Pathh 88 Productions

I think @Francis-Crossman is just trying to make sure you will see what he expects. There is more than one way to get there.

If you see a dialogue that allows you to specify speakers, then it increases the chances that you problem is related to which track the dialogue is on or other issues (audio quality).

Screenshots might help.

Stan

Report · May 24, 2023

In my particular instance right now: Stereo track, studio recording of a 1.5 hour interview. Interviewer and Interviewee on track 1 and track 2 respectively. Took about 30 minutes to transcribe. When finished both speakers (male & female) both showed up as "Unknown" and I was unable to change the speakers names.

Re-transcribed the same interview and it worked the second time.

Kind of an issue burning the extra 30 minutes to re-do stuff when/if it fails the first time. Need a solid solution that makes sure Premiere is not going to get it wrong. So, I'll follow Francis' advice and see if that paves the way to a consistent result.

I have 30 days of interviews to plow through....

Report · May 24, 2023

Also, anyone getting fluxuating transcribe times? Adobe touts 10x, but I'm around 5x, rough estimate overall, and sometimes more like 3x. Is it dependant on system resources and will multi-tasking affect the times?

Report · May 24, 2023

So this is a 90 minutes interview that took 30 minutes to transcribe. It failed to seperate the voices even though "show speakers" is tick-boxed.

So...yeah, now I'll "re-transcribe" again. As you can see, pretty time consuming when it fails. Cool service, but I can't figure out how to get it consistent.

Report · May 24, 2023

Don't know if this is a clue or not, but when I launch the Transcript function when the "show program monitor transcript" icon is activated, this is what I see...a selected AI Transcription is underway. However, as you can also see, when the "show source monitor transcript" icon is activated, Premiere says "No Dialog Found".

So, this UI is a bit confusing to me. Am I using it wrong? I don't know.

Now, on the other hand, everytime I've attempted a re-transcription when the "Show Source Monitor Transcript" icon was activated and an actual clip was in that window, the transcription has worked.

Report · May 24, 2023

Sepreating Speakers during a transcription seems to work when I launch the transcription from this window:

However, Seperating Speakers Seems to fail and give me the "Unknown" problem when I launch the transcription from this window:

I'll conclude by acknowledging that I'm running a system with two extra monitos, if that factors into the issue at all.

Premier Vers. 23.4.0 (Build 56) 3.5 GHz Quad-Core Intel Core i5, Radeon Pro 575 4 GB, 64 GB 2400 MHz DDR4

Works:

Doesn't work:

Report · May 24, 2023

Report · May 24, 2023

Dear Francis-Crossman, the updated transcription interface has new bells and whistles that make it more confusing, and I'm getting the same problem as the others. All my speakers are identified as "unknown" which didn't happen in the previous version on the same exact interviews.

In addition, when I try to re-transcribe, that menu item is gray-out and therefore unavailable.

When I select Source Monitor transcript, it successfully separates out the speakers, but I'm not sure how to deal with that when an interview has more than one clip. I believe there are several bugs in this new interface that need to be fixed.

Report · May 25, 2023

@Pathh 88 Productions,

Thanks for the screenshots and especially the video. Very helpful.

This is a challenging workflow. It only takes a detail or 2 and you are quickly into the weeds. But it can just as quickly get back on track. While you get it sorted, work with short clips. I have noticed long transcribe times, but I am not working with material as long as yours.

Separating Speakers.

Sometimes, you have used the 3 dots menu to confirm that "Show speakers" is checked. This setting, however, only tells PR to show the speaker designations in the transcript window. It does NOT mean that speakers will be identified during transcription.

And then when you used the transcribe button in the "untranscribed sources" prompt, it did not have speakers set.

When you get the "Create source media transcription" dialogue, you get the actual "Separate speakers" option. And then it works.

I have not discovered exactly when it does not show the dialogue and whether it sometimes ignores the speaker separation if you set it in preferences.

In any event, check Edit -> Preferences -> Transcription and be sure you have speaker separation set there. If it shows "Select an option," it is not set. You can set it there by turning on "Automatically transcribe clips," setting speakers to "Yes, separate speakers," and then turning off "Automatically transcribe clips."

Editing Speakers.

If you have speaker separation on and manually or through the auto-transcribe create a transcript for a Source media file (i.e. a clip, whether in a sequence or not), you can edit speaker names as long as you are viewing the transcript in the Source Monitor view. If you are in the Program Monitor/timeline view, you do not have the 3 dots to the left of the speaker name and get a hover message "To edit speaker names, make changes in the Source transcript." Just double-click the clip (to open in the Source Monitor), and you can edit the speaker name in the transcript.

Also note that if you select the timeline/Program Monitor, and click the 3 dots in the Transcript tab, you can pick "Generate Static Transcript." This is the "old" style transcript. For this one, you can edit the speaker names when the timeline/Program Monitor is active.

No Dialogue Found.

> when the "show source monitor transcript" icon is activated, Premiere says "No Dialog Found".

This primarily happens any time you select Source Monitor view and there is no source open in that monitor. Or the source that is active doesn't have dialogue. Or it doesn't have it on the first audio track - Source Media transcription only looks at audio track one. For this purpose, "track 1" is your stereo track, not just one of the channels.

There is a workaround for the track 1/source issue.

Follow Active Monitor.

There are situations where you want to turn this off. But my preference so far is to leave it turned on. All this does is to set the view to whatever monitor you were in last. So, for example, if I want to edit speakers and I am in the timeline with a clip that has a source transcript, I am seeing the Program Monitor/timeline view of the transcript - and the speakers will not be editable. I just double-click on the clip, it opens in the Source Monitor, I switch to the Transcript tab - where Follow Active Monitor now shows the source view, and the speakers are editable.

Yes, a lot to unpack...

Stan

Report · May 25, 2023

@jonskurprods,

My post to @Pathh 88 Productions may help with some of your questions.

Yes, multiple clip source transcriptions pose special challenges. See my post here:

https://community.adobe.com/t5/premiere-pro-discussions/ai-transcribe-for-multiple-tracks/m-p/138145...

Let us know what you come up with. Lots of directions to take this.

Stan

Report · May 25, 2023

Hello I'm having the same issue. Anything larger than 10GB can significantly slow down the system and consume memory. However, I believe in this concept by Adobe.

Report · May 25, 2023

Woa. Thanks Stan. That is alot. I'll have to pour over that closely. Seems a bit needlessly complicated, but as long as it functions reliably somehow at the end of the day...

Report · May 25, 2023

FWIW, after all my posts here, I basically stepped back a version of Premiere and started using that. Too much muck to deal with on the 23.3.0 version. Anyone reading this in the future just realize that this itenteration of Premiere is a bit buggy on the transcripts. Also the UI, but that's for another thread.

I do see why Adobe is implementing transcripts in this fashion, as it'll allow trascribed words to carry across multiple sequences when they are attached to a source rather than a timeline, but needs a touch of coding refinement before I rely on trascribing in this version of the app.

Report · May 25, 2023

A big issue I have is that I'm working with off-board .wav audio recordings that go uninterrupted for hours. Like, 4 hours each. Unfortunately, the actual part I want trascribed might only be 15 minutes.

Ideally, I'd slap that huge audio source in a sequence, edit out the parts I don't want, and allow Premiere to only look there and ignore the rest.

However, it looks like they way they're implementing the newer features of transcribe, is that it'll analyze the whole source clip...and the best way you can get 'Identify Speakers' to work is to tell Premiere to analyze a source clip.

Is your expereience jibe'ing with my analysis?

Report · May 25, 2023

@Pathh 88 Productions,

See this staff post in the Beta forum:

https://community.adobe.com/t5/premiere-pro-beta-bugs/text-based-editing-doesn-t-work-with-multiple-...

You can open your wav in the Source monitor, mark in/out, add to a sequence (with or without video), and do a static transcription of that sequence. Then use a nest of that sequence where you want that audio/transcript.

Let us know if this works for you.

Stan

Edit: I meant to add. Yes, you can transcribe an audio-only file. And when you add audio (nested or not), the transcript follows it. And Nico's comment about using a static transcript: I thought they were different creatures - source media transcript for clips and editing and static transcript for sequence and captions. But if you use a sequence as a nest, its static transcript becomes editable.

Report · May 26, 2023

Thanks for the advice. I will try to experiement and see what happens. I'm bouncing between versions of Premiere depending on what I need to do.

I tried right clicking a few source files in my project window, and then asking for them to be transcribed. Interestingly, my source files typically have 6 tracks and all six tracks show up in the progress window. That tells me it's analyzing all six tracks one at a time. That's a shame. Track1 of the file is the "mix" and it would be nice if Premiere only looked there to transcribe.

Do you know if there's a way to do that?

After all, having to wait as long as a day for 1 of audio is not very productive.

Report · May 26, 2023

check Edit -> Preferences -> Transcription and be sure you have speaker separation set there. If it shows "Select an option," it is not set. You can set it there by turning on "Automatically transcribe clips," setting speakers to "Yes, separate speakers," and then turning off "Automatically transcribe clips."

This solution might be what other's need to make transcribe work as requested in the OP?

Report · May 27, 2023

>

check Edit -> Preferences -> Transcription and be sure you have speaker separation set there. If it shows "Select an option," it is not set. You can set it there by turning on "Automatically transcribe clips," setting speakers to "Yes, separate speakers," and then turning off "Automatically transcribe clips."

> This solution might be what other's need to make transcribe work as requested in the OP?

Yes, I think of the several ways to deal with it, that one is key.

Stan

Report · May 27, 2023

@Pathh 88 Productions

Great detective work. It is my belief that such transcribes will only use track 1. But I just tested a dual track file and it was processing two tracks. The workaround is to nest as described - when doing so, you can pick audio 1 or mix. I just tested, and the static transcription of the dual track sequence showed only one row in the progress panel.

But I'd like some staff input to guide you:

@Francis-Crossman @nbechere @Kevin-Monahan Who best to address this?

Stan

Adobe Support Community

Premiere Pro Transcription Not Identifying Separate Voices