• Global community
    • Language:
      • Deutsch
      • English
      • Español
      • Français
      • Português
  • 日本語コミュニティ
    Dedicated community for Japanese speakers
  • 한국 커뮤니티
    Dedicated community for Korean speakers
Exit
1

24.0 Speech to text transcription fails to start

Explorer ,
Oct 20, 2023 Oct 20, 2023

Copy link to clipboard

Copied

  • Issue - Speech to text "Transcribe" button triggers choices of language, speakerrs... but then pushing "Transcribe" >> nothjing happens
  • Adobe Premiere Pro version number: 24.0
  • Operating system - Windows 
  • System Info: CPU, GPU, RAM, HD:
    • Device name MEDIASTATION
      Processor 11th Gen Intel(R) Core(TM) i9-11900K @ 3.50GHz 3.50 GHz
      Installed RAM 64.0 GB (63.8 GB usable)
      System type 64-bit operating system, x64-based processor
      Scratch disk: 18 TB
      HD: 57 TB

  • Video format: 
    Type: MXF
    File Size: 14.82 GB
    Image Size: 4096 x 2160
    Frame Rate: 29.97
    Source Audio Format: 48000 Hz - 24-bit - 4 Channels
    Project Audio Format: 48000 Hz - 32 bit floating point - 4 Channels
  • Workflow details: Speech to text worked fine on some auto-transcribe on import. 
    Steps to reproduce - (Very important!) open clip in Source monitor
    - open window Text
    - push "tranbscribe"
    - choose language English or UK English
    - choose speakerr labelling >> Yes separate speakers
    > push Transcribe
    >> nothing happens


    I tried to Modify audio channels to: Preset Mono instead of Use File, but it makes no difference. Shows Clip 1, 2, 3, 4 with corresponding 4 Media Surce channels. HOwever the program transcribed other clips, without modificaiton, upon import, including in German language 
  •  
  • Expected result - normal transcription
  • Actual result -  nothing
Bug Unresolved
TOPICS
Editing and playback

Views

917

Translate

Translate

Report

Report
Community guidelines
Be kind and respectful, give credit to the original source of content, and search for duplicates before posting. Learn more
community guidelines
14 Comments
Participant ,
Oct 26, 2023 Oct 26, 2023

Copy link to clipboard

Copied

Same here.  If I select "auto transcription" and import the same clips, transcription works.  But not a fan of auto-transcription, it can really bogged down the system and want to leave this off.

Votes

Translate

Translate

Report

Report
Community Expert ,
Oct 29, 2023 Oct 29, 2023

Copy link to clipboard

Copied

@OneWorldComm,

 

Thanks for that detailed report; sorry you didn't get a response sooner. This is an evolving process and feedback is very helpful. I have not experienced the problem you describe, but that may be due to not having tried a clip with the same properties.

 

PR 24 added transcription of audio other than channel one for source media, but only for mono. Stereo has been added in the Beta version.

 

Auto-transcription still looks only at audio track one.

 

If PR recognizes the file as having multiple channels, it adds "Channel Selection" to the options in the "Create Transcription for Source Media" dialogue. If it does not see multiple channels, you do not see that option. Are you seeing that option for your problem clip?

 

Note that the Sequence/Static Transcription gives options for which Audio track is to be transcribed.

 

In some earlier tests, prior to the multichannel capabilities, I did not find that mapping the file helped. But worth a try.

 

@nbechere Thoughts?

 

Stan

 

 

Votes

Translate

Translate

Report

Report
Explorer ,
Oct 29, 2023 Oct 29, 2023

Copy link to clipboard

Copied

Thanks for the follow up Stan. I found rhat creating a static transcription of the clips in a sequence is the only way to have the transcription feature work, apart from auto transcript upon import which I do not think works consistently (I didn't keep a record but some clips have transcript others do not after import, and I think I asked for auto transcript, but not absolutely sure.) 

Opening a clip in the Source monitor, with "Follow active monitor" checked, and the window which says "Transcribe source" unfortunately does not function. In audio channels settings, I changed clip channel format to Mono (no difference), and the main audio is on "Clip 1" (top track). Nothing happens. Is there any solution to have the feature work, as offered in the software? Or, am I misunderstanding this feature?

 

Votes

Translate

Translate

Report

Report
Explorer ,
Oct 29, 2023 Oct 29, 2023

Copy link to clipboard

Copied

Stan, as a follow upo to my reply just now, I did the following: put all the source clips (single audio track, from an iPhone) from an interview into the timeline and when the text window reported some of the clips not transcribed I asked it to transcribe them and it proceeded to do so.  I assume this is a non-static transcription. These clips were different from the previous clips I mentioned which are 4 audio channel clips .MXF from a professional camera.  

Votes

Translate

Translate

Report

Report
Community Expert ,
Oct 29, 2023 Oct 29, 2023

Copy link to clipboard

Copied

Thanks for the update.

 

Yes, plain clips with stereo sound should work consistently.

 

And I think there is something about the camera clips you have that is not working in PR 2024. They should not simply fail, so there's a problem to be solved.

 

While looking at these options, I indulged myself and tried to list all the ways to get to a source transcription button.

Auto-transcribe - all or only when a clip is added to a sequence; and from the beginning of a project or by setting auto-transcribe later in preferences. When auto-transcribing, you do not get a Create transcription dialogue;

Right-click in Project Panel and pick Transcribe - you can select multiple clips, but you may not get multi-channel options;

In "Source Monitor transcript view" in the Transcript tab, click the Transcribe button in the "Transcribe source" message OR click the 3-dots menu and pick "Transcribe clip";

In "Program Monitor transcript view" in the Transcript tab, you will get a message about untranscribed source clips. If you click the transcribe button for all or one, you will NOT get the transcriptions options dialogue.

In "Program Monitor transcript view" in the Transcript tab, if you have a Static Transcript already, the 3 dot menu gets you to an option to redo the source transcription. I don't know what effect, if any, this has on the original transcriptions.

 

Stan

 

 

 

 

Votes

Translate

Translate

Report

Report
Participant ,
Oct 29, 2023 Oct 29, 2023

Copy link to clipboard

Copied

Issue seems to be with clips having more than 2 CH audio. Transcribing from a bin works with clips from a Sony A74 DSLR (with 2 audio channels) but not with clips from a Sony FX6 camera (MXF with 4 audio channels). Those MXF files are pretty standard on all Sony cinema cameras.

Cheers,

[cid:image001.png@01DA0A88.603E8130]

Thierry

THIERRY HUMEAU | TELECAM FILMS
DIRECTOR OF PHOTOGRAPHY - FAA Licensed Drone Pilot

Votes

Translate

Translate

Report

Report
Community Expert ,
Oct 29, 2023 Oct 29, 2023

Copy link to clipboard

Copied

I'd love to get a short sample of one of the files that doesn't work.

 

Stan

 

Votes

Translate

Translate

Report

Report
Participant ,
Oct 29, 2023 Oct 29, 2023

Copy link to clipboard

Copied

How would you like me to send it?

Thierry

THIERRY HUMEAU | TELECAM FILMS
DIRECTOR OF PHOTOGRAPHY - FAA Licensed Drone Pilot

Votes

Translate

Translate

Report

Report
Community Expert ,
Oct 30, 2023 Oct 30, 2023

Copy link to clipboard

Copied

Sent you a PM.

 

Stan

 

Votes

Translate

Translate

Report

Report
Community Expert ,
Oct 30, 2023 Oct 30, 2023

Copy link to clipboard

Copied

Thanks for the file.

 

Short answer: there are problems with some mxf files.

 

In the 24.0 PR Release version, I was not able to transcribe either as source media or as static in a sequence.

 

In the Beta 24.1.0 Build 74, I was not able to transcribe as source media, but I could transcribe as static in a sequence.

 

Staff are actively working on multichannel transcription of source media, and I suspect these mxf issues are related.

 

They may already have all the mxf samples they need, but perhaps not.

 

@nbechere, telecam2's file is from Sony FX6 with 4 audio channels.

 

Stan

 

Votes

Translate

Translate

Report

Report
Community Expert ,
Nov 02, 2023 Nov 02, 2023

Copy link to clipboard

Copied

Thierry,

 

Update....

 

Here's my post today in the thread looking at this in the Beta forum:

https://community.adobe.com/t5/premiere-pro-bugs/premiere-pro-2024-0-not-transcribing-source-clips/i...

 

Your clip is working in the Beta, so eventually this will get sorted. (There's a separate issue with auto-transcribe.)

 

A workaround suggested by another user:

https://community.adobe.com/t5/premiere-pro-bugs/text-based-editing-not-generating-transcript-quot-n...

 

In PR 24, map the audio to a single mono channel. Then right-click and transcribe.

 

Right-click in the project panel, Modify -> Audio Channels. It should show Mono and 4 Clips. Change it to 1 Clip and select only Channel 1. Click okay.

 

Then in the Project Panel, right-click, Transcribe.

 

Does that work?

 

Stan

 

 

Votes

Translate

Translate

Report

Report
Participant ,
Nov 02, 2023 Nov 02, 2023

Copy link to clipboard

Copied

Great to hear.  Thanks.

Votes

Translate

Translate

Report

Report
Participant ,
Dec 05, 2023 Dec 05, 2023

Copy link to clipboard

Copied

I tested just tested HDcam clips (MXF) with 4 channels sound  release Premiere v2024.03 on win10.

If there no sound on track 1 no transicription takes place.

If I only set channel 2 in modify audiochannels (which has speech), transcription still failes, but it works in the timeline.

With MP4 files it works. (stereo)

 

So it should be possible to transcribe only the selected clips in the project panel, other wise the text to edit function is

not usable.

 

Steps to repro

import a hdcam clip (mxf) with multichannel audio

try to transcribe from the project panel.

 

result

it failes when audio 1 is silent

it failes when try to overrule with audiomapping setting

 

 

Votes

Translate

Translate

Report

Report
Community Expert ,
Dec 05, 2023 Dec 05, 2023

Copy link to clipboard

Copied

LATEST

@theok8577996,

 

See this feature request with an update as of late October.

https://community.adobe.com/t5/premiere-pro-ideas/audio-track-selection-for-source-media-transcripti...

 

PR 24.0.0 and 24.0.3 work with mono track multichannel. Multichannel stereo works in the latest Beta.

 

The was an issue with Sony FX camera MXF, but I think those are now working in the latest Beta.

 

Still being actively worked on.

 

Stan

 

Votes

Translate

Translate

Report

Report