Community Manager

Answered

[Now Released] Enhance Speech in Premiere Pro

Forum|Forum|2 years ago
September 13, 2023
29 replies
32045 views

With AI-powered Enhance Speech now in Premiere Pro (beta), you can magically remove noise and improve the quality of dialogue with one click, so it sounds as if it were recorded in a professional studio! We need your feedback to optimize this feature further through adding a comment below and completing a short survey.

Here’s how to use it:

Open the Essential Sound panel and select a clip containing speech in your sequence. Click on “Dialogue."

Then, just click the “Enhance” button. When processing is complete, you can adjust the amount of enhancement using the Mix Amount slider. This slider allows you to mix your raw audio with the enhanced audio, allowing natural background noise to come through.

What kind of recordings work well with Enhance Speech?

Audio that is recorded with a low-quality microphone (phones, online meetings, on-camera mics) tend to be improved with Enhance Speech. It does not always work well with:

Extremely very poor-quality audio (e.g. a recording from an old VHS tape with heavy artifacting)
Multiple overlapping speakers
Whispers
Loud background music
Singing

How does it work?

The version of Enhance Speech within Premiere Pro (beta) is the same feature that has been available online via Adobe Podcast. However, Enhance Speech within Premiere Pro (beta) has been optimized to perform locally on your machine, allowing you to run Enhance Speech on an unlimited number of clips. Unlike Adobe Podcast’s service, no internet connection is required. The model is not trained on your usage.

As indicated in the name, this won’t work with music, sound effects, or ambient audio. And like most AI-powered features, it requires a performant system; processing times may vary. (See Premiere Pro’s recommended hardware specifications.)

Please check out our full FAQs for this feature for more details.

What we’d love to know from you:

AI models are evolving fast and voice recordings have many unique variables we can’t always predict in our testing. We need your feedback to learn more about how you’re using Enhance Speech so we can further optimize it for all types of voices.

How has this been helpful? Have you run into any enhancement issues that prevent you from using the feature? If you’ve run into performance issues, please tell us what kind of computer you’re using.

Complete this survey and leave us feedback below.

This topic has been closed for replies.

Correct answer Oliver315800333k8f

I installed the beta just to use this feature, but when I click enhance there is no progress bar at all and nothing happens. I can change the mix amount, but this has no effect. Even when rendering out a file there is no change to the audio. Anyone else run into this?

I'm in 24.1.0 Build 77 on a iMac running Ventura 13.5.1 (22G90).

E

Elie101

Participating Frequently

Will you be fixing the bug with intel chip Macpros. Works great with the M chip, but locks the computer up if trying this feature on the intel chip.

C

Clay35408472knw4

Participant

I love the enhance speech feature to remove background noise, but it seems like the compression is set too high and it makes lower volume spoken words sound distorted and unnatural. Is there a way the compression can be adjusted manually?

L

lloyd_pdx

Known Participant

Attempted to clean up some spoken word audio, not too noisy to begin with. The PP version was noticeably inferior to the clip uploaded to the podcast enhance model. Curious if this is performance related (M1 Max, 64gb RAM) or if they are different models. Waves Clarity Vx also outperformed the PP version of Enhance Speech.

D

DanWSS

Participant

Hi,

Can anyone help me. I tried to use this feature on my Mac but if i tried to do anything else the whole mac would freeze (even just browsing on the web). I then tried this feature on a rubbish laptop which it worked i just had to leave it for several hours. I then moved the file back over to my Mac to finish editing, the enhanced speech however hasn't moved over and the subject sounds the same as originally.

Is there a way to move the enhanced speech across machines as the laptop is currently stuck on trying to prepare audio (8 of 201) which has taken 15 minutes.

My mac spec are: 3.8 GHz 8-Core Intel Core i7, AMD Radeon Pro 5500 XT 8 GB, 128 GB 2667 MHz DDR4

Laptop specs are: 11th gen i5, 8GB of ram.

Thanks

S

Scott.C.

Inspiring

I'm unable to use enhance speech on a fairly standard stereo audio file. Does ES not support 96khz? Seems to be greyed out!

Windows 10

AMD 3960

256GB Ram

PrPro 24.2.1

A

altk3y

Participating Frequently

The Enhance Audio feature makes my audio, which is recorded both by an external mic and camera mic, sound like it's underwater if it's anywhere above 0.3. Tested with all sorts of different clips.

A

adamb35870899

Participant

WOW! Played with this for 5 minutes on some very challenged dialogued.......Night and day difference. I'm ALL IN on this.

AndrewTheGreat

Known Participant

This feature is useless for russian\ukrainian or any other Slavic language since it adds an american accent to words (and even subsitutes slavic words to english ones sometimes) especially in those parts of the speech where the sound quality is worse. Seems like Adobe uses no slavic models of speech to train enchance speech Ai. So far this feature is useless for 400 000 000 people...

C

Caique348495265soj

Participant

Impressionado com a praticidade na correção de áudio... este novo recurso veio para facilitar ainda mais as edições e o melhor de tudo é que as alterações sempre preservão a naturalidade da voz.

G

Guadalupe N

Participant

Nothing happening for my audio. 'Enhancing Speech' stays at 0%.