Skip to main content
Known Participant
April 4, 2016
Answered

Solving Duplicate Master Clips AFTER they have been edited into timelines

  • April 4, 2016
  • 5 replies
  • 20306 views

I'm editing using the most recent version of Premiere on the most recent version of OSX.

I'm working with two other editors who have the same versions of Premiere and OSX as me. We have been importing sequences/project files back and forth for several months, and we didn't realize that this was causing the master clips from each sequence to create duplicates of themselves upon each import from one project file on one editor's computer to another.

When we realized it was happening, it caused an organizational nightmare, and we didn't know how to fix it.

After reading through this guide: Reuse clips and work across multiple projects | Adobe Premiere Pro CC tutorials I think we've figured out how to prevent dupes going forward.

HOWEVER, we have a huge number of duplicate clips that we can't get rid of now. If we delete one dupe master clip, it deletes itself on whatever timeline it's been used with. We will lose our work if we delete any of our master clips.

My question is: is there a way to make Premiere realize that all of our duplicate master clips are the same media and winnow them down without deleting their appearances on our timelines?

THANK YOU

Correct answer Kevin-Monahan

Hi Mjshade,

is there a way to make Premiere realize that all of our duplicate master clips are the same media and winnow them down without deleting their appearances on our timelines?

I don't believe so. All these imported clips have different XMP IDs, so that Premiere Pro thinks that they are not related to each other. You need to enable writing XMP ID on import before you even begin the project so that Premiere Pro can track what's what. Otherwise, I think you'll have to live with this anomaly, which I agree, can get quite nasty.

I'm writing up a workflow doc to assist others in a "shared projects" workflow, but I'm afraid most of the time a situation like yours occurs where you get the info too little too late.

If anyone else has ideas, I'd like to hear them.

Thanks,

Kevin

5 replies

Participant
February 28, 2020

ugh, no! the solution to this problem isn't to turn XMP writing on, it's to turn it OFF. This problem of PP not recognizing media on import it COMPLETELY manufactured by adobe. It doesn't completely solve the problem (Adobe has shown little interest in fixing this issue (its been a huge problem for years) but:
1: go into the preferences and UNCHECK every preference having to do with XMP. Do this on every computer that will open a project containing the shared media. Quit and reopen PP several times to make sure your setting are all saved (Adobe, like a sleazy russian spam bot, will try and reset the XMP in order to boost usage of their pathetic, unusable, metadata system.)

2: ingest the media and if you are going to do any "Modify" settings on the clips, such as switching stereo audio to  mono, etc, do it now, because once you ingest media into multiple projects and then "Modify" in one, the other project will not reconcile the 2 clips. (Adobe's pathetic developers aren't competent enough to manage this "confusion")

3: you should be good to go, but make sure you copy media into each version of your edit project before you start trying to move sequences back and forth. Definitely keep an eye out for duplicate media bins popping up, and trouble shoot when you do, otherwise you will start multiplying your media database and pretty soon you will be out of control and you will crash your project.

4: Pray to whatever god you choose to reduce the scam artists at Adobe into dust

Participant
November 9, 2017

I FOUND A SOLUTION! It worked for me at least. It takes a bit of time but for projects that are huge like mine, I think it's worth to spend some hours "debugging".

I used the last version of premiere cc 2018.

Here it is how i did it:

1) Make sure that in the original project with dup master clips you have the “Write XMP ID to files on import” activated.

2) Create a new project (I didn’t close the original one given that 2018allows you to have several projects open).

3) Make sure the “Write XMP ID to files on import” option is activated in the new project.

4) Open Media Browser.

5) Make sure that in the media browser settings you have the option “Allow Duplicate Media During Project Import” Off, unchecked, i mean, NOT selected!

6) Browse for the original project in your hard drive using Media Browser.

7) Drag the sequence from the original project to the root of the new empty (use media browser. If you drag it from the original project opened, didn't work for me). It will create the folder structure where the master clips are.

8) Drag the other sequence (the one your other editor prepared and used to point to the dup master clips) to the root of the new project. Voilà! Problem solved. No duplicate master clips.

9) Repeat the operation. You can drag several sequences at a time, but if you drag a lot, premiere wouldn't import anything.

You’ll notice that some times creates the same folder structure, and it seems that is duplicating the clips, but if you go inside the bins, you’ll see that it’s only duplicating the folder structure and inside the bins there are the clips that were not included when you dragged the first sequence.

After that it’s a matter of just organizing the project a little bit.

I had 90 days of shooting, then synced sequences with plural eyes so when i imported them it duplicated the clips. Then also worked with a second editor making cuts of some of the sequences. When i imported those, it duplicated the footage again. So in some cases I had 3 master clips and opening the project and loading clips would take me forever. It took me a couple of hours to “re-do” the project, importing from media browser and organizing it again. But in my case was worth it.

Hope this helped.  

Kevin-Monahan
Community Manager
Community Manager
November 9, 2017

Hi AlexL,

That is a stupendous workflow win that you have discovered via the backdoor of new project sharing feature. Congratulations. I will report this to the team. I hope this will work for others that have the same problem.

Regards,
Kevin

Kevin Monahan - Sr. Community and Engagement Strategist – Adobe Pro Video and Audio
Participant
November 10, 2017

Thank you,

Yes, please, tell the team. I'm pretty sure they can program it and come up with an option in the software like "consolidate duplicate master clips" or something like this, and automatize the whole process i did manually... the result would be a new project where there are no duplicate clips automatically and faster than doing one by one.

Thank you.

Participant
March 5, 2017

Not sure if anyone else figured out this method, but I will post anyway (just in case).

I have a similar situation.

Scenario:

Multiple editors working from the same media on different machines.  When editor 1 finishes a sequence(s), they email the project file to editor 2.  Then, in many cases, a tweak is made and editor 1 resends their project file.  Importing the sequence(s) often times leads to a forced import of duplicate master clips despite leaving "Allow importing duplicate media" unchecked.  As you know, this could be a logistical nightmare having multiples of the exact same file.

After researching, I found and article that describes the way Premiere works when importing sequences.  When leaving "Allow importing duplicate media" unchecked, Premiere looks at the available media and determines whether a clip in the imported sequence is the same by checking all file data including original file location.  If it sees any discrepancies, Premiere imports a duplicate clip thinking it's original. (or something to that effect)

On a hunch, I did the following and successfully imported a project without having the duplicate clips.  Here are the steps.

1. close your "working" project

2. open downloaded project master file.

3. relink all clips.

4. save project.

5. return to your "working" project.

6. import downloaded project (or selected sequences).

7. be sure to leave "Allow importing duplicate media" UNCHECKED.

When relinking each clip to the same file as your "working" project, this eliminates any discrepancy issues.  So, when importing new sequences from other projects into your "working" project, Premiere recognizes that the clips in the imported sequences as the same, it does not import the duplicates.

Doing the relinking process can take be quick or slow depending on how organized your media is, but its better than having duplicates.

Kevin-Monahan
Community Manager
Community Manager
March 6, 2017

Hi Anthony,

For collaboration and moving into the future, we are now recommending moving your staff to Team Projects. Is that a possibility?

Thanks,
Kevin

Kevin Monahan - Sr. Community and Engagement Strategist – Adobe Pro Video and Audio
Participant
May 29, 2017

The fact that Premiere "Pro" does not allow to at the very least manually indicate that two clip references are in fact one and the same is to me yet another highlight of how badly designed software it is. Also, relinking any larger volumes of assets beyond few dozens/hundreds at a time brings random crashes.

The number of bugs and frustration this program keeps offering through the years is just stunning.

Inspiring
January 26, 2017

Hi,

I'm working on a similar project: multiple computers/projects using the same OS & PrPro version 2015.4.

We get duplicate clips when importing sequences from within projects through Media Browser (or if we import a sequence that was exported as a project). We don't get duplicates for all clips, and the main difference between the duplicates and the originals is the Video Duration (same as In/Out Duration that you would see in AVID).

We think when Premiere is importing these sequences it is referencing the In/Out points (Video Duration) to determine if the clip is new to the project or old. Did you find the same Video Duration difference?

What were you referencing when you said "I think we've figured out how to prevent dupes going forward."?

R Neil Haugen
Legend
January 26, 2017

The whole sentence is:

"After reading through this guide: Reuse clips and work across multiple projects | Adobe Premiere Pro CC tutorials I think we've figured out how to prevent dupes going forward."

There are two video tutorials on that link by Max Jago, a very good teacher of video-post. Have you checked those out?

Neil

Everyone's mileage always varies ...
Inspiring
January 26, 2017

I know & I did: these videos did not answer my problem. He does have a great tutorial for bringing in new clips, and help if you WANT duplicate clips, but these videos do not tell you what to do in case you are getting duplicate clips you don't want.

I do not have "allow duplicate clips" checked.

Kevin-Monahan
Community Manager
Kevin-MonahanCommunity ManagerCorrect answer
Community Manager
April 4, 2016

Hi Mjshade,

is there a way to make Premiere realize that all of our duplicate master clips are the same media and winnow them down without deleting their appearances on our timelines?

I don't believe so. All these imported clips have different XMP IDs, so that Premiere Pro thinks that they are not related to each other. You need to enable writing XMP ID on import before you even begin the project so that Premiere Pro can track what's what. Otherwise, I think you'll have to live with this anomaly, which I agree, can get quite nasty.

I'm writing up a workflow doc to assist others in a "shared projects" workflow, but I'm afraid most of the time a situation like yours occurs where you get the info too little too late.

If anyone else has ideas, I'd like to hear them.

Thanks,

Kevin

Kevin Monahan - Sr. Community and Engagement Strategist – Adobe Pro Video and Audio
Inspiring
January 26, 2017

Hi Kevin,

**Thanks ahead of time for your help!!**

We are running into an issue with duplicate clips and the source media is from a C300. The XMPs for the original clip and the duplicates are the same (via reveal in finder). We thought it was a spanned clip issue -- Premiere reads a spanned clip in timeline and brings in other half of file as a whole clip -- but this also happens to normal C300 files.

I posted this reply to someone else who is trying to help with our workflow.

-----

"No, we haven't been creating subclips. And I checked the project where the sequence originates from for duplicate clips, but did not find any.

Below are screenshots of my workflow and the duplicates (sorry for any redundant info!).

1) via Media Browser navigate to project and import sequence only.

2) Within the new folder containing the sequence and any (supposedly) missing clips from my Master Media Project, I find the duplicate clips.

3) We thought that the spanned clips were the issue: when we import the C300 files initially we would override Premiere's import of the extra clip (how premiere sees spanned clips is combining them into one, so we'd see two clips with identical TRTs and TC, but with different names. i.e. A0003201 & AA0003202), or delete the extra clip from the project altogether. With this new sequence import/duplicate clip issue, we thought Premiere was seeing a spanned clip and bringing in the other half of the clip again.

4) But we're also getting duplicate C300 clips that aren't spanned.

5) The original clip and duplicate are almost identical.

6) EXCEPT for the Video Duration: which as far as I can see is Premiere's way of telling us the In/Out Duration.

Please let me know if I'm missing anything!

Did you run into this?"

Inspiring
January 27, 2017

Hi Kevin, and whoever else might need this,

We found out what our specific issue is.

In our Master Ingest Project we checked "Write XMP ID to files on import" for all clips, most of which were C300 files.

So all of our duplicates and originals shared the same XMP file.

We went through all the different modifications you could make to the clip, trying to see if there was a main difference beyond Video Duration, and one of us saw that the Audio Channels were different between the two clips.

When importing C300 files we set a rule to change audio channels from the native Stereo / 1 Channel format to Mono / 2 Channel format. A couple of these clips were missed (probably on days where the pressure was on) and that is what made Premiere think there were two different clips.

The master Media Project was not modified, but the editor modified his clips, and this was not matched on our end in the Master Media project. So when we imported a sequence from the editor we got duplicate clips.

We think that when a clip is interpreted at the Project level, then Premiere sees a Project level clip and Timeline level clip as two different clips when importing a sequence.

Hopefully this helps anyone who might be having issues. Kevin, your posts did help out team out a lot when it came to figuring this out.

Thanks for the assistance!