DISCUSS: New Captions Workflow in Premiere Pro

[Francis-Crossman]

UPDATE: January 29, 2021

Since the innitial post back in October of last year we have made a ton of progress and some of the details originally posted here are no longer acurate.  I have updated the post to be more accurate to the state of things today.  

Here are some important changes to be aware of

• The Premiere Pro beta is now version 15 (starting January 26, 2021)
• The captions workflow in on by default - no need to enable it
• The beta menu has been removed (because you don't need it anymore - the advanced beta features are always on)
• Applications for speech to text early access has closed and those who have been accepted should have recieved an email.  The email you used to apply needs to match the email (Adobe ID) you use to log into creative cloud. If you did not recieve an email stating that you have been accepted, or if you are logged into creative cloud using a different email you will contininue to see the message stating that speech to text is coming soon.
• Broadcast closed captions are now supported CEA 608/708, OP47, Teletext, EBU Subtitles.
• Exporting is working (burned-in, sidecar, embedded) and queue to Media Encoder is working too now.

Thanks to everyone for testing and for all your awesome feedback! - Francis

The captioning workflow in Premiere Pro is getting a complete makeover and you can be the first to try it out!  We have a new text panel for editing and viewing your captions as text.  Captions now have their own track on the timeline so they can be edited just like video.  Styling uses the power of the Essential Graphics panel so you can make fantastic looking captions. 

Best of all – we will be adding speech to text and auto captions powered by Adobe Sensei – coming later.

 

Some important things to know before you start testing this feature

1. Just like any beta software, we do not recommend using this for mission critical projects since features are likely to change over time. 
2.  The Premiere Pro beta has been updated to the next major version – 15.  This means your projects will NOT be backwards compatible with the current shipping version of Premiere Pro – 14.x.  All projects created in Premiere Pro Beta, even if you don’t use captions, will be saved as version 15. 
3. Opening existing projects in Premiere Pro Beta will ask you to save a copy of your project in the new project version. Take extra care with Team Projects since you do not get a version update warning and you can mess up the project for your entire team!
4. If you have existing captions in a project that gets upgraded, we will convert from the old style captions to the new style.  We will do our best to match the styling, but do not guarantee a pixel-perfect transition. 

So, if you’re good with all that, read on . . .

Enabling the Feature:

1. Update to the latest Beta version - you're done.  It's on by default now

Quickstart Guide: 

Download this sample project to follow along PR New Captions Workflow quickstart.zip

1. Open the sequence The climber - start here and familiarize yourself with the spoken dialog.
2. Open the Text panel from the window menu and make sure it’s showing the Captions tab.
3. Locate the SRT file in the project panel The Climber - subtitles.srt
4. Drag the SRT file into the sequence and drop it anywhere. 
5. A new caption track is created, and all the caption items are placed at the correct time.
6. Place the playhead over one of the caption items to select it.  This should activate the Essential Graphics panel into editing mode.
7. Change the Style in the Essential Graphics panel by choosing a different preset from the Style dropdown.
8. Notice the font, size, color, and background have been updated.
9. Play the sequence and watch the captions follow along in the Text panel.

Play around with visual styles in the Essential Graphics panel and try editing the text in the Text panel.  Read on for more detailed info on the various pieces of the workflow.

The Text Panel
Open the Text panel from the Window menu.  This is where you interact with text and it has two tabs – Transcript and Captions

 

1. Text panel – open from the Window Menu
2. Transcript tab – This is where you can create automatic speech to text transcriptions, navigate the transcript, and create automatic captions.  This is only available to those who been accepted into the eary access program for speech to text.  All others will continue to see the "coming soon" graphics.
   
3. Captions tab – Navigate and edit caption text.
4. Search – find characters, words and phrases in your captions.
5. Next / Previous search result – use to navigate search results.
6. Replace / Replace All – used to replace search results with new text.
   
7. Add Caption – this will place a blank caption at the playhead in the current sequence
8. Caption number – a sequence number to count your captions
9. Timecode – TC start and stop of the current caption item.  This is not editable.  To change the timing of the caption, edit it in the sequence.
10. Caption text – the text of the caption itself.  Double click to edit.

The Caption track - working with captions in the Sequence

We have completely reimagined the way captions work in Premiere Pro. If you have used captions previously in Premiere Pro, this is totally different – much better we think. Please tell us what YOU think by leaving a public comment below.

 

Create and delete caption tracks

There are a few ways to create a new caption track.  You can drag an SRT file onto the Sequence or use the “Create new captions track” button in the Captions tab of the Text panel. To delete a caption track, right-click on the caption track header and choose “delete track”

Drag an SRT file on the sequence

Dragging an SRT caption file onto the Sequence will automatically create a new caption track at the top of the Timeline.

Keyboard Shortcuts

To see all the keyboard shortcuts available for captions, open the keyboard shortcuts menu from the Premiere Pro menu and search for "caption".  Here are some notable ones.  There are many other which do not have default assignments.

1. Add a captions track - option/alt + command/ctrl + A
2. Add a new caption segment at the playhead- option/alt + command/ctrl + C
3. Go to next caption segment in the timeline - option/alt + command/ctrl + UP
4. Go to next caption segment in the timeline - option/alt + command/ctrl + down

Captions tracks

 

1. Caption track setting – the CC button

This can hide the caption track area or solo just the active caption track if you have more than one.  It is useful if you want to declutter your timeline. It does not turn off the active caption track from rendering in the program monitor, however. 

• Hide all caption tracks
• Show all caption tracks
• Show active caption track only 

2. Active Track/Visibility – the eyeball icon

This will enable/disable Program Monitor viewing of the Caption track selected. Only one Caption track can be active at a time, so when you make one track active, the other tracks will automatically be disabled. You can also choose to disable all Caption tracks. Inactive Caption tracks will dim making it easier to note your active Caption track. 

3. Label

By default, this will show the caption track format (eg Subtitles, CEA-708, CEA-608, etc.) You can right-click the Caption track header and choose Rename to choose a custom name (same functionality as A/V tracks)

4. Right-click the caption track header

Additional caption tracks can be added by right-clicking in the caption track header – choose “Add Track”. You can also delete or rename a caption track in the same way.

5. Caption tracks area

Caption tracks will always be at the top of the sequence. Additional caption tracks are added on top. This will continue until you have reached 25% of the Timeline vertical space, then the tracks will stop “growing” and scroll bars will appear to the right. Caption tracks will never take up more than 25% of the upper space of the Timeline. This is dynamic, so if you increase or decrease the Timeline panel height, the 25% will adjust accordingly.

6. Track Lock

Lock the track to prevent editing.  This functions the same as A/V tracks.

7. Track Targeting

The Caption track header has a ‘Toggle the track targeting for this track’ button with same functionality as A/V tracks.

8. Sync Lock

The Caption track header has a ‘Toggle Sync Lock’ button with same functionality as A/V tracks.

Editing timing of caption items on the track

You can use all the familiar editing tools that you are used just like editing video and audio.

 

• Select (one or many) You can select multiple Caption track items by Shift-selecting each item or marquee/lasso select items or use Select All (which will also include other items in tracks like video, audio, etc.)
• Trim
• Ripple Trim
• Razor/Add Edit: You can add an edit/razor a Caption item as you would with any Timeline item and Track Targeting is supported. The difference is that when you razor a Caption item, both items will have the same text which you can then modify in the Text panel
• Copy/Paste: paste of Caption item(s) follows Track targeting which allows you to copy and paste captions items between tracks.

Styling with the Essential Graphics panel

Open the Essential Graphics panel from the Window menu.  This is where you choose things like font, size, color and position. Make sure you have at least one caption selected. This will activate the Edit tab of the Essential Graphics panel. If you have created and stylized text in Premiere Pro before, the following should be very familiar to you. However, for captions we are adding small enhancements such as zones, and vertical text alignment.

Styles

• Create Master Text Styles for consistent styling across the entire captions track. A style saves all the settings made in the Essential Graphics panels, including font, alignment, color and more. Setting a Master Text Style to one caption applies it to all captions on the track. You can have different styles for different tracks.
• Sync from Master Style and Push to Master Style: When changing the look of a caption you may want to push this change to the entire track for consistency, that’s were Push to Master Style comes into play. Or you might want to revert an edit to a caption back to the Master Style. Then use Sync from Master Style.
•  

Text

• Font: Set font, font style and font size.
• Paragraph Alignment: For horizontal alignment use Left align text, Center align text, Right align text and Justify. We have now also added Vertical alignment with Top align text, Center text vertically and Bottom align text. This defines how a caption grows when adding additional lines. As an example, there is a good chance you will want a caption to be bottom aligned, this way a single line caption and the second line of a two-line caption will always be in the same vertical position.
• Tracking: Loose or tighten the space between characters.
• Leading: Loose or tighten the vertical space between lines.
• Faux Styles: Bold, Italic, All Caps, Small Caps, Superscript, Subscript, Underline.

Align and Transform

• Position captions with zones: You can choose from different zones to position your caption in different areas on screen, e.g. bottom center.
• Fine tune position: Through Set Horizontal and Set Vertical Position you can add an offset to your zone setting.
• Change the text box size: If you want to shrink or expand the text box size you can do this through Set Horizontal Scale and Set Vertical Scale. This will affect text wrapping and paragraph align settings.

Appearance

• Fill: Change the color of your captions.
• Stroke: Add single or multiple strokes. The Graphics Properties menu under the wrench menu gives you more control over stroke styling.
• Background: Add a background box. You can choose the color, add additional padding and change the opacity.
• Shadow: You can add a shadow and fine tune with controls such as opacity, angle, distance and more.

Transcribing the dialog into captions

You have three options for transcribing your audio and creating captions: speech to text, use a third-party service, or do it by hand.

Speech to text

• Text Panel > Transcript tab
• Only available for those who have applied and been accepted to the speech to text early access program.  Other will not have access to this feature.

Use a third-party service

If you already have a workflow that uses a third party transcription service, you can bring in that file.  SRT is the best option.

1. Import the SRT file into your Premiere Pro project just like any piece of media
2. Drag the SRT from the project panel into your sequence and let go anywhere
3. A new caption track is automatically created, and the captions are placed on the track

Do it by hand

For short sequences, doing it by hand may not too much trouble.

1. Open Text panel from the Window menu
2. Go to the Captions tab of the Text Panel
3. Press the “Add Captions Track” button – a new captions track is added to your current sequence
4. Place the playhead at the beginning of your first piece of dialog (hint – use the waveforms in the audio to help align)
5. Press the “+” button near the top of the Captions tab of the Text Panel to add a blank caption
6. Double click on <Type your caption here> to go into edit mode
7. Type out the caption text
8. Trim the end of the caption in the timeline to align with the end of the spoken dialog
9. Repeat for each caption you wish to add
10. See the other sections on Working with captions in the Sequence and Styling with the Essential Graphics panel for more details on editing and styling.

Exporting your sequence with captions

There are three options for exporting captions: burned in, sidecar file, or embedded into the video file.  

1. Make sure the caption track you want exported is visible by toggling the eyeball on (Toggle Active Captions Track).
2. Choose File > Export
3. Open the Captions tab in the export settings and choose burn in, sidecar or embedded
4. Burned in and sidecar are supported with any encoding preset
5. Embedded is limited to pro codecs like MXF OP1a, DNX, and Prores and requires that the caption track format be set to one of the broadcast standards like CEA-608
6. Click Export
7. Sidecar files will be saved next to the video file with the same name
8. Queueing to Media encoder is supported too

Happy captioning!  Once again, we welcome your feedback.  Please leave comments below.

[Parker Gibbons]

Thanks Huckstero and Johan, we have just scoped out work for a keyboard-driven approach to this workflow. There won't be additional UI like this added, but there will be a keyboard shortcut to drop a caption block at the playhead that automatically sets you in a text-entry mode to type out the caption. Stay tuned! Hope to get your feedback once it is available. 

[johnpooley3]

Please multi-thread the caption import process and add a preference to Prelude to disable caption import. 

[Stan Jones]

V 13.8.31 Wow; lots of little fixes regularly. I played around a bit back in 14.7, and I see so many differences already. But it is hard to sort out this thread, since many functions missing earlier are already added and bugs are fixed. A good problem to have. Congratulations to the team for taking on this task and making good progress so far. Captions are used for many purposes and come in an amazing array of flavors.

I note that editing caption text in the Program Monitor is added. Functionality seems okay. At first, I did not like that clicking in the caption block did not activate the text tool, and takes a double click. But this is the same behavior as the regular graphics text box. Keystroke selection works (e.g. Ctrl-Shift-Arrow selects words), and Right-Click copy/paste/cut work as expected.

In the caption Text Panel, the selection keystrokes work. But Ctrl-C and Right-click copy do not work, and, while Ctrl-X removes text, it does not copy it. I thought Ctrl-V and Right-click paste did not work, but they do if there is a good copy operation (e.g. a copy operation from a regular graphics text box or, outside PR, from copy from notepad).

Re comment above about Hard Breaks adding an odd character box, I do not see this problem. 

https://community.adobe.com/t5/premiere-pro-beta/discuss-new-captions-workflow-in-premiere-pro/m-p/1...

Stan

[Nate McFadden]

Thanks, Stan. Appreciate all your time on the forums. Cheers.

[Stan Jones]

Thanks, Nate. Sorry I've been busy and slow to get onto the Beta changes!

Stan

[ElJayBronx]

For some reason in the current Beta (14.8.0 Build #32[R]) I'm having difficulty adding captions. I have a play script from which I'm copying, and double-clicking with the prior version opened the box and it was easy to add the new caption. This version it takes numerous times double-clicking to get the gray box to turn black which is the sign it's ready for text to be added. 

Additionally, this annoying object (at red arrows):

seems to like to interpose when I do any editing whatever to the text I've copied in.

The only way to remove it is to get in front of it and press <Backspace>; <delete> doesn't have its usual effect. It only seems to occur when editing in the Text|Captions window, not in the Program Monitor (I note that this wasn't previously possible and apparently now is because I'm doing it...)

That one is an annoyance but the lack of ease of getting the Caption box in the Captions window ready to edit is doubly so. Please if anyone knows a way to work around this let me know or PLEASE fix it, this wasn't a problem with the prior beta version. 

[Alexander Riss]

Thank you for the feedback on the latest version. This "flickering" when trying to edit is a bug which will be fixed in tomorrows beta build. Please let us know if you still see that issue after the next update. 
Are you working on Windows or on a Mac? We are currently adressing multiple input related issues specifically on windows.

[ElJayBronx]

I just downloaded the latest Beta build which is 34[R]. I am now COMPLETELY unable to enter text into the Captions|Text window. Double-clicking just brings up a flicker and return to the unenterable state. Which begs the question why IS there an unenterable state? Why is that box not simply open to typing or pasting without doing a double-click (better yet...a keyboard shortcut!) 

The only workaround available at the moment seems to be copying the last caption on the timeline and pasting, then editing in the Program Monitor. Otherwise, no text is getting added to the project. 

While I'm at it...thanks for making SRT export available. How about making it available from the Edit|Export menu so that when the Captions window is active Captions livens up as an export option? Then we could export JUST the captions without having to set up an entire project, and turn off the Captions window to avoid doing a burn-in?

Thanks for considering...

[ElJayBronx]

I forgot to answer an important question: I'm in Windows 10 Pro, updated to 20H2, the latest. My self-built machine has an i9 processor, 64G RAM. OS and programs are on an M.2 drive. This does appear to be the "tomorrow" build you promised. It is WORSE than the last one (32[R])- at least with it, I could eventually get the box to respond EVENTUALLY. This one AT NO TIME allows entry of text. Some improvement. I'm very disappointed and frustrated. I expected better from your post.

[Nate McFadden]

'Tomorrow's build' will be 035. Sorry for any confusion.

[ElJayBronx]

Very good news; to quote Scarlett O'Hara (GONE WITH THE WIND): "Tomorrow is another day!"

[ElJayBronx]

I guess the promise of 035 "tomorrow" was a bit optimistic (since I'm writing on 12/14 and the "tomorrow" fix to these entry difficulties was indicated on 12/10...) While I have found ways to work around the caption-entry issues in Windows, this version can't come too soon; OTOH delayed is better than release before it's ready...

[Alexander Riss]

I am very sorry - what i meant to say was that the problem is already fixed in the next internal build. As you noticed these builds dont get posted to the beta program every day depending on our internal certification process. So the next build that passes these checks will also include the fix for the flickering caption input.

[ElJayBronx]

First of all...no need for an apology! Second: This morning, Version 14.9 Build 6[R] arrived this morning, and it solved absolutely the "flickering" issue. 

The only remaining issues that affect my own work are:

1. that odd character I (and others) have posted about that occurs when I attempt to edit in the captions window; while the issue can be worked around by doing all editing in the program monitor, that character, similar to Unicode character U+2612 (ballot box "X") needs to be banished from the program.
2.  Export of SRT (from File|Export|Captions) with timeline or caption window active, without having to export the entire timeline, and
3. Carry captions into subsequences.

I really appreciate the work that's gone into this. It will likely be found to be the #1 way to create and use captions in the industry, far more convenient than so many. If the Transcript section is robust it will cement this and likely make Premiere Pro the go-to captioning program.  

[ElJayBronx]

•  Then we could export JUST the captions without having to set up an entire project, and turn off the Captions window to avoid doing a burn-in?

  Thanks for considering...

Didn't mean Captions WINDOW - translate that to Captions TRACK. Turn THAT off to avoid burning in captions after SRT export. Sorry for the confusion...

[johankokken]

+1 for Captions only export 

[ElJayBronx]

I note that when creating a sub-sequence the captions do NOT follow.  This should be an easy fix and should happen! I needed to make a clip demoing the new captions - I had to do it directly from the timeline and thus couldn't engineer in a dissolve in or out...would have to import and re-export the clip, not the best practice. Thanks...

[Trent Happel]

Thanks for all the feedback! Unfortunately, we don't have subsequence working yet for captions. It is under investigation, but I can't give an ETA. 

[Akira_Kato]

Someone else had applied, but I didn't get a reply to that comment, so I have a request.

I would like you to add support for importing/exporting WebVTT (.vtt) caption files.

Recently, we have been streaming video to the Web, and WebVTT conversion has become a bottleneck for us.

[johankokken]

Will it be possible to (automatically) group media and (ebu stl-)captions (so they can be used in de source monitor)? In our news department we make several updates from the same story, and re-using the already translated captions would be an enourmous timesaver. Also, our captions are being archived, so if you later use 20" from a 50' show, you don't have to manually isolate the right piece of a captions track, or manually recreate them.

Alternatively, import and overlay captions on source window would be convenient.

Possibility to turn captions track on/off in source window.

Thanks for all the effort, the new captions workflow is far more convenient and robust than the old one. Can't wait to start using it at VRT.

[Parker Gibbons]

Thanks for the feedback, Johan! We're currenly developing the source monitor workflow, and for video files that contain embedded captions that are loaded into the source monitor, the wrench menu will contain options for switching between caption streams in the file, or turning them off all together. When that embedded caption video file is added to the timeline, all of the caption blocks will be linked to the video and move in sync with it. Would that address the needs you are asking for, or is there additional functionality we could include that I am missing? 

[claub]

Hi. 

Thank you for the improvements with the caption track.

However I am quite confused about the use of styles. In our organization our users need to have the same style available as a default every time they create a caption track - or at least available with one click.
But as I see it in the beta, the styles are only saved as a part of a project. And when you open a new project, your saved styles are gone, and you are back to zero regarding fonts, letter sizes and all that. Or have I missed something?

In the old Caption window you could load styles that were present in the users "Captions Presets" folder in Finder.
What is the best way of saving styles for use in all projects?

[GurpreetSingh]

Thanks for the feedback. Loading styles from libraries is on the team's backlog but I don't have an ETA. Styles can be saved and loaded as files from the disk - so even now you will be able to share styles and import them into a new project. Hope that helps!

[claub]

Hi gurpsin.
Thanks for the info about loading styles. However, no matter how much I look for it, I can't find the way to load and save files from disk in the beta like you describe it.
Can you please enlighten me?
If a user has no way of loading styles in an easy way, I am afraid that we won't be using this caption workflow 😞 

[iambencurtis]

To me, and my crazy brain, it makes sense to be able to tab from one caption entry to another as to be able to flow quickly with making multiple edits. This would function the same using shift+tab, but with moving backwards in the list. Is this something that makes sense to others, and if so, how likely is it that such functionality might be implemented?