24.0 Speech to text transcription fails to start

[OneWorldComm]

• Issue - Speech to text "Transcribe" button triggers choices of language, speakerrs... but then pushing "Transcribe" >> nothjing happens
• Adobe Premiere Pro version number: 24.0
• Operating system - Windows 
• System Info: CPU, GPU, RAM, HD:

  • Device name MEDIASTATION
    Processor 11th Gen Intel(R) Core(TM) i9-11900K @ 3.50GHz 3.50 GHz
    Installed RAM 64.0 GB (63.8 GB usable)
    System type 64-bit operating system, x64-based processor
    Scratch disk: 18 TB
    HD: 57 TB

• Video format: 
  Type: MXF
  File Size: 14.82 GB
  Image Size: 4096 x 2160
  Frame Rate: 29.97
  Source Audio Format: 48000 Hz - 24-bit - 4 Channels
  Project Audio Format: 48000 Hz - 32 bit floating point - 4 Channels
• Workflow details: Speech to text worked fine on some auto-transcribe on import. 
  Steps to reproduce - (Very important!) open clip in Source monitor
  - open window Text
  - push "tranbscribe"
  - choose language English or UK English
  - choose speakerr labelling >> Yes separate speakers
  > push Transcribe
  >> nothing happens
  
  I tried to Modify audio channels to: Preset Mono instead of Use File, but it makes no difference. Shows Clip 1, 2, 3, 4 with corresponding 4 Media Surce channels. HOwever the program transcribed other clips, without modificaiton, upon import, including in German language 
  
•  
• Expected result - normal transcription
• Actual result -  nothing

[telecam2]

Same here.  If I select "auto transcription" and import the same clips, transcription works.  But not a fan of auto-transcription, it can really bogged down the system and want to leave this off.

[Stan Jones]

@OneWorldComm,

Thanks for that detailed report; sorry you didn't get a response sooner. This is an evolving process and feedback is very helpful. I have not experienced the problem you describe, but that may be due to not having tried a clip with the same properties.

PR 24 added transcription of audio other than channel one for source media, but only for mono. Stereo has been added in the Beta version.

Auto-transcription still looks only at audio track one.

If PR recognizes the file as having multiple channels, it adds "Channel Selection" to the options in the "Create Transcription for Source Media" dialogue. If it does not see multiple channels, you do not see that option. Are you seeing that option for your problem clip?

Note that the Sequence/Static Transcription gives options for which Audio track is to be transcribed.

In some earlier tests, prior to the multichannel capabilities, I did not find that mapping the file helped. But worth a try.

@nbechere Thoughts?

Stan

[OneWorldComm]

Thanks for the follow up Stan. I found rhat creating a static transcription of the clips in a sequence is the only way to have the transcription feature work, apart from auto transcript upon import which I do not think works consistently (I didn't keep a record but some clips have transcript others do not after import, and I think I asked for auto transcript, but not absolutely sure.) 

Opening a clip in the Source monitor, with "Follow active monitor" checked, and the window which says "Transcribe source" unfortunately does not function. In audio channels settings, I changed clip channel format to Mono (no difference), and the main audio is on "Clip 1" (top track). Nothing happens. Is there any solution to have the feature work, as offered in the software? Or, am I misunderstanding this feature?

[OneWorldComm]

Stan, as a follow upo to my reply just now, I did the following: put all the source clips (single audio track, from an iPhone) from an interview into the timeline and when the text window reported some of the clips not transcribed I asked it to transcribe them and it proceeded to do so.  I assume this is a non-static transcription. These clips were different from the previous clips I mentioned which are 4 audio channel clips .MXF from a professional camera.  

[Stan Jones]

Thanks for the update.

Yes, plain clips with stereo sound should work consistently.

And I think there is something about the camera clips you have that is not working in PR 2024. They should not simply fail, so there's a problem to be solved.

While looking at these options, I indulged myself and tried to list all the ways to get to a source transcription button.

Auto-transcribe - all or only when a clip is added to a sequence; and from the beginning of a project or by setting auto-transcribe later in preferences. When auto-transcribing, you do not get a Create transcription dialogue;

Right-click in Project Panel and pick Transcribe - you can select multiple clips, but you may not get multi-channel options;

In "Source Monitor transcript view" in the Transcript tab, click the Transcribe button in the "Transcribe source" message OR click the 3-dots menu and pick "Transcribe clip";

In "Program Monitor transcript view" in the Transcript tab, you will get a message about untranscribed source clips. If you click the transcribe button for all or one, you will NOT get the transcriptions options dialogue.

In "Program Monitor transcript view" in the Transcript tab, if you have a Static Transcript already, the 3 dot menu gets you to an option to redo the source transcription. I don't know what effect, if any, this has on the original transcriptions.

Stan

[telecam2]

Issue seems to be with clips having more than 2 CH audio. Transcribing from a bin works with clips from a Sony A74 DSLR (with 2 audio channels) but not with clips from a Sony FX6 camera (MXF with 4 audio channels). Those MXF files are pretty standard on all Sony cinema cameras.

Cheers,

[cid:image001.png@01DA0A88.603E8130]

Thierry

THIERRY HUMEAU | TELECAM FILMS
DIRECTOR OF PHOTOGRAPHY - FAA Licensed Drone Pilot

[Stan Jones]

I'd love to get a short sample of one of the files that doesn't work.

Stan

[telecam2]

How would you like me to send it?

Thierry

THIERRY HUMEAU | TELECAM FILMS
DIRECTOR OF PHOTOGRAPHY - FAA Licensed Drone Pilot

[Stan Jones]

Sent you a PM.

Stan

[Stan Jones]

Thanks for the file.

Short answer: there are problems with some mxf files.

In the 24.0 PR Release version, I was not able to transcribe either as source media or as static in a sequence.

In the Beta 24.1.0 Build 74, I was not able to transcribe as source media, but I could transcribe as static in a sequence.

Staff are actively working on multichannel transcription of source media, and I suspect these mxf issues are related.

They may already have all the mxf samples they need, but perhaps not.

@nbechere, telecam2's file is from Sony FX6 with 4 audio channels.

Stan

[Stan Jones]

Thierry,

Update....

Here's my post today in the thread looking at this in the Beta forum:

https://community.adobe.com/t5/premiere-pro-bugs/premiere-pro-2024-0-not-transcribing-source-clips/i...

Your clip is working in the Beta, so eventually this will get sorted. (There's a separate issue with auto-transcribe.)

A workaround suggested by another user:

https://community.adobe.com/t5/premiere-pro-bugs/text-based-editing-not-generating-transcript-quot-n...

In PR 24, map the audio to a single mono channel. Then right-click and transcribe.

Right-click in the project panel, Modify -> Audio Channels. It should show Mono and 4 Clips. Change it to 1 Clip and select only Channel 1. Click okay.

Then in the Project Panel, right-click, Transcribe.

Does that work?

Stan

[telecam2]

Great to hear.  Thanks.

[theok8577996]

I tested just tested HDcam clips (MXF) with 4 channels sound  release Premiere v2024.03 on win10.

If there no sound on track 1 no transicription takes place.

If I only set channel 2 in modify audiochannels (which has speech), transcription still failes, but it works in the timeline.

With MP4 files it works. (stereo)

So it should be possible to transcribe only the selected clips in the project panel, other wise the text to edit function is

not usable.

Steps to repro

import a hdcam clip (mxf) with multichannel audio

try to transcribe from the project panel.

result

it failes when audio 1 is silent

it failes when try to overrule with audiomapping setting

[Stan Jones]

@theok8577996,

See this feature request with an update as of late October.

https://community.adobe.com/t5/premiere-pro-ideas/audio-track-selection-for-source-media-transcripti...

PR 24.0.0 and 24.0.3 work with mono track multichannel. Multichannel stereo works in the latest Beta.

The was an issue with Sony FX camera MXF, but I think those are now working in the latest Beta.

Still being actively worked on.

Stan