Locked

Conforming & Indexing of Files

LEGEND ,
Sep 22, 2010

Copy link to clipboard

Copied

Wil Renczes, from Adobe, just posted a great outline of what happens with Conforming and Indexing of files on Import. He was replying in the PrPro forum, but you can substitute PrE for PrPro in his post, as they are the same here. He also addresses why/how Conforming can not take, and the program will do this every time that the Project is opened, though the processes have already taken place before.

Wil writes:

PPro generates two potential sidecar files for audio - PEK and CFA files.  The PEK file is simply a quick data pass of the audio data that allows the app to draw waveforms (ie it should be pretty quick) - the CFA files are required if the file source is either too slow to decode the audio in realtime (like some MPEG long GOP, for instance), or if there's a mismatch in the sample rate depth.  The idea is that the conform files will match your sequence's audio bitrate settings so that the app can play & mix audio in realtime.

How does PPro track these additional files?  Every file that is imported is stamped with XMP, which is how we handle metadata on source files.  XMP creates a unique ID which the app uses as a lookup value when it wants to find the PEK & CFA files that it generated for a file.  So, usually, if you have a project where certain clips constantly reconform, it has something to do with XMP.  Why? Usually it's because XMP can't write to the file.  So, every time you launch PPro and open the same project, the media file has no XMP data, so it tries to generate a new ID, so any old CFA/PEK files have an ID mismatch and the app thinks it needs to generate new ones.

Typical cases why XMP can't stamp files:

- the media file is read-only.

- the media's hard drive is read-only.

- the file itself is corrupted/malformed, and XMP takes the safe route & decides not to try to write any additional data to the file.  (I've personally witnessed this occur with WAV files captured by a Tascam field recorder.)

- someone deleted the XMP files by hand (certain media types have it as a sidecar .XMP file instead of embedded).  (Don't laugh - I recently encountered a case where people had instituted a server folder rule to delete all files on a network share that weren't .mpg. )

A workaround you can try:

There's a preference setting to turn off injecting XMP into your media.  If that setting is in effect, PPro will not rely on the XMP ID for the CFA/PEK files.

One other note, if your problem is specific to MPEG files:  it might be that PPro isn't able to index the file properly.  If it can't index, it might be trying to re-index on each launch;  audio conforming always triggers after indexing.   So watch for it constantly indexing - if that's the case, all the XMP stuff I described above has nothing to do with the problem.  It's a side effect of something in the MPEG stream that we're barfing on.  If you do see it constantly re-indexing MPEG files, it would be really helpful to send in a sample so that we can examine the stream.

Cheers Wil

If someone is having problems with continuing Conforming, though it completed earlier, think about what Wil has said.

Good luck,

Hunt

TOPICS
Tips and tricks

Views

53.8K

Likes

Translate

Translate

Report

Report
Community Guidelines
Be kind and respectful, give credit to the original source of content, and search for duplicates before posting. Learn more
LEGEND ,
Nov 29, 2010

Copy link to clipboard

Copied

Along with Wil's comments, here is a bit of background on the Conforming and PEK generation process. Premiere will need to Conform the Audio Stream to create the CFA files, which will be 48KHz and 32-bit, floating point, for accurate editing. Premiere can handle a lot of popular Sample-Rates and Bit-Depths, but some can create problems. The closer that the Audio Stream is to 48KHz 16-bit (the DVD/BD standard), the easier it is for Premiere to Conform. The farther away the Audio Stream from those specs., the longer that it will take. The total time to Conform is related to how far off the Audio Stream is, the Duration of the file(s) Imported and the speed of one's computer. The progress bar tells you how much Conforming has been done per file, and gives an indicataion of how much Conforming is left to do. It is a good practice to not touch the computer, while Conforming is on-going, as this can cause the process to stop (usually leading to truncated Audio), the program to crash/hang, or even the computer to crash/hang.

The PEK file is the Waveform Display, that one sees, when the Audio Clip is placed onto the Timeline, or opened in the Source Monitor.

The CFA and PEK files are stored in the Media Cache, and located where one sets them in the Edit>Preferences>Scratch Disks.

For some background info on the Media Cache, see this ARTICLE.

Hunt

Likes

Translate

Translate

Report

Report
Community Guidelines
Be kind and respectful, give credit to the original source of content, and search for duplicates before posting. Learn more
Community Beginner ,
May 18, 2011

Copy link to clipboard

Copied

If you do see it constantly re-indexing MPEG files, it would be  really helpful to send in a sample so that we can examine the stream.

 

Where would I look to see this indexing?

Likes

Translate

Translate

Report

Report
Community Guidelines
Be kind and respectful, give credit to the original source of content, and search for duplicates before posting. Learn more
LEGEND ,
May 18, 2011

Copy link to clipboard

Copied

Where would I look to see this indexing?

There is a progress bar in the lower-right of the GUI. The progress bar was blue, but in later versions of PrPro, I think that it is now yellow.

For short Duration files on a fast system, this progress might well go by too quickly to even display. With longer Durations, or on slower systems, it will definitely appear.

Hope that this helps,

Hunt

Likes

Translate

Translate

Report

Report
Community Guidelines
Be kind and respectful, give credit to the original source of content, and search for duplicates before posting. Learn more
New Here ,
Aug 01, 2011

Copy link to clipboard

Copied

Could you please explain exactly how to get to the Preference about injecting XMP data and turning it off?

Likes

Translate

Translate

Report

Report
Community Guidelines
Be kind and respectful, give credit to the original source of content, and search for duplicates before posting. Learn more
LEGEND ,
Aug 02, 2011

Copy link to clipboard

Copied

That would be a question to post to the appropriate forum for your version of PrPro.

I do not have an answer for you, but feel certain that others will. If you are using PrPro CS 5, or 5.5, Colin, Wil or Todd can probably answer all of your questions.

Good luck,

Hunt

Likes

Translate

Translate

Report

Report
Community Guidelines
Be kind and respectful, give credit to the original source of content, and search for duplicates before posting. Learn more
LEGEND ,
Aug 30, 2011

Copy link to clipboard

Copied

Also, see the Adobe KB Article on Conforming Audio.

Hunt

Likes

Translate

Translate

Report

Report
Community Guidelines
Be kind and respectful, give credit to the original source of content, and search for duplicates before posting. Learn more
the_wine_snob AUTHOR LATEST
LEGEND ,
Apr 12, 2012

Copy link to clipboard

Copied

For info on the Media Cache Database, see this Adobe KB Article.

Hunt

Likes

Translate

Translate

Report

Report
Community Guidelines
Be kind and respectful, give credit to the original source of content, and search for duplicates before posting. Learn more