Skip to main content
Known Participant
April 4, 2016
Answered

Solving Duplicate Master Clips AFTER they have been edited into timelines

  • April 4, 2016
  • 5 replies
  • 20302 views

I'm editing using the most recent version of Premiere on the most recent version of OSX.

I'm working with two other editors who have the same versions of Premiere and OSX as me. We have been importing sequences/project files back and forth for several months, and we didn't realize that this was causing the master clips from each sequence to create duplicates of themselves upon each import from one project file on one editor's computer to another.

When we realized it was happening, it caused an organizational nightmare, and we didn't know how to fix it.

After reading through this guide: Reuse clips and work across multiple projects | Adobe Premiere Pro CC tutorials I think we've figured out how to prevent dupes going forward.

HOWEVER, we have a huge number of duplicate clips that we can't get rid of now. If we delete one dupe master clip, it deletes itself on whatever timeline it's been used with. We will lose our work if we delete any of our master clips.

My question is: is there a way to make Premiere realize that all of our duplicate master clips are the same media and winnow them down without deleting their appearances on our timelines?

THANK YOU

Correct answer Kevin-Monahan

Hi Mjshade,

is there a way to make Premiere realize that all of our duplicate master clips are the same media and winnow them down without deleting their appearances on our timelines?

I don't believe so. All these imported clips have different XMP IDs, so that Premiere Pro thinks that they are not related to each other. You need to enable writing XMP ID on import before you even begin the project so that Premiere Pro can track what's what. Otherwise, I think you'll have to live with this anomaly, which I agree, can get quite nasty.

I'm writing up a workflow doc to assist others in a "shared projects" workflow, but I'm afraid most of the time a situation like yours occurs where you get the info too little too late.

If anyone else has ideas, I'd like to hear them.

Thanks,

Kevin

5 replies

Participant
February 28, 2020

ugh, no! the solution to this problem isn't to turn XMP writing on, it's to turn it OFF. This problem of PP not recognizing media on import it COMPLETELY manufactured by adobe. It doesn't completely solve the problem (Adobe has shown little interest in fixing this issue (its been a huge problem for years) but:
1: go into the preferences and UNCHECK every preference having to do with XMP. Do this on every computer that will open a project containing the shared media. Quit and reopen PP several times to make sure your setting are all saved (Adobe, like a sleazy russian spam bot, will try and reset the XMP in order to boost usage of their pathetic, unusable, metadata system.)

2: ingest the media and if you are going to do any "Modify" settings on the clips, such as switching stereo audio to  mono, etc, do it now, because once you ingest media into multiple projects and then "Modify" in one, the other project will not reconcile the 2 clips. (Adobe's pathetic developers aren't competent enough to manage this "confusion")

3: you should be good to go, but make sure you copy media into each version of your edit project before you start trying to move sequences back and forth. Definitely keep an eye out for duplicate media bins popping up, and trouble shoot when you do, otherwise you will start multiplying your media database and pretty soon you will be out of control and you will crash your project.

4: Pray to whatever god you choose to reduce the scam artists at Adobe into dust

Participant
November 9, 2017

I FOUND A SOLUTION! It worked for me at least. It takes a bit of time but for projects that are huge like mine, I think it's worth to spend some hours "debugging".

I used the last version of premiere cc 2018.

Here it is how i did it:

1) Make sure that in the original project with dup master clips you have the “Write XMP ID to files on import” activated.

2) Create a new project (I didn’t close the original one given that 2018allows you to have several projects open).

3) Make sure the “Write XMP ID to files on import” option is activated in the new project.

4) Open Media Browser.

5) Make sure that in the media browser settings you have the option “Allow Duplicate Media During Project Import” Off, unchecked, i mean, NOT selected!

6) Browse for the original project in your hard drive using Media Browser.

7) Drag the sequence from the original project to the root of the new empty (use media browser. If you drag it from the original project opened, didn't work for me). It will create the folder structure where the master clips are.

8) Drag the other sequence (the one your other editor prepared and used to point to the dup master clips) to the root of the new project. Voilà! Problem solved. No duplicate master clips.

9) Repeat the operation. You can drag several sequences at a time, but if you drag a lot, premiere wouldn't import anything.

You’ll notice that some times creates the same folder structure, and it seems that is duplicating the clips, but if you go inside the bins, you’ll see that it’s only duplicating the folder structure and inside the bins there are the clips that were not included when you dragged the first sequence.

After that it’s a matter of just organizing the project a little bit.

I had 90 days of shooting, then synced sequences with plural eyes so when i imported them it duplicated the clips. Then also worked with a second editor making cuts of some of the sequences. When i imported those, it duplicated the footage again. So in some cases I had 3 master clips and opening the project and loading clips would take me forever. It took me a couple of hours to “re-do” the project, importing from media browser and organizing it again. But in my case was worth it.

Hope this helped.  

Kevin-Monahan
Community Manager
Community Manager
November 9, 2017

Hi AlexL,

That is a stupendous workflow win that you have discovered via the backdoor of new project sharing feature. Congratulations. I will report this to the team. I hope this will work for others that have the same problem.

Regards,
Kevin

Kevin Monahan - Sr. Community and Engagement Strategist – Adobe Pro Video and Audio
Participant
November 10, 2017

Thank you,

Yes, please, tell the team. I'm pretty sure they can program it and come up with an option in the software like "consolidate duplicate master clips" or something like this, and automatize the whole process i did manually... the result would be a new project where there are no duplicate clips automatically and faster than doing one by one.

Thank you.

Participant
March 5, 2017

Not sure if anyone else figured out this method, but I will post anyway (just in case).

I have a similar situation.

Scenario:

Multiple editors working from the same media on different machines.  When editor 1 finishes a sequence(s), they email the project file to editor 2.  Then, in many cases, a tweak is made and editor 1 resends their project file.  Importing the sequence(s) often times leads to a forced import of duplicate master clips despite leaving "Allow importing duplicate media" unchecked.  As you know, this could be a logistical nightmare having multiples of the exact same file.

After researching, I found and article that describes the way Premiere works when importing sequences.  When leaving "Allow importing duplicate media" unchecked, Premiere looks at the available media and determines whether a clip in the imported sequence is the same by checking all file data including original file location.  If it sees any discrepancies, Premiere imports a duplicate clip thinking it's original. (or something to that effect)

On a hunch, I did the following and successfully imported a project without having the duplicate clips.  Here are the steps.

1. close your "working" project

2. open downloaded project master file.

3. relink all clips.

4. save project.

5. return to your "working" project.

6. import downloaded project (or selected sequences).

7. be sure to leave "Allow importing duplicate media" UNCHECKED.

When relinking each clip to the same file as your "working" project, this eliminates any discrepancy issues.  So, when importing new sequences from other projects into your "working" project, Premiere recognizes that the clips in the imported sequences as the same, it does not import the duplicates.

Doing the relinking process can take be quick or slow depending on how organized your media is, but its better than having duplicates.

Kevin-Monahan
Community Manager
Community Manager
March 6, 2017

Hi Anthony,

For collaboration and moving into the future, we are now recommending moving your staff to Team Projects. Is that a possibility?

Thanks,
Kevin

Kevin Monahan - Sr. Community and Engagement Strategist – Adobe Pro Video and Audio
Participant
May 29, 2017

The fact that Premiere "Pro" does not allow to at the very least manually indicate that two clip references are in fact one and the same is to me yet another highlight of how badly designed software it is. Also, relinking any larger volumes of assets beyond few dozens/hundreds at a time brings random crashes.

The number of bugs and frustration this program keeps offering through the years is just stunning.

Inspiring
January 26, 2017

Hi,

I'm working on a similar project: multiple computers/projects using the same OS & PrPro version 2015.4.

We get duplicate clips when importing sequences from within projects through Media Browser (or if we import a sequence that was exported as a project). We don't get duplicates for all clips, and the main difference between the duplicates and the originals is the Video Duration (same as In/Out Duration that you would see in AVID).

We think when Premiere is importing these sequences it is referencing the In/Out points (Video Duration) to determine if the clip is new to the project or old. Did you find the same Video Duration difference?

What were you referencing when you said "I think we've figured out how to prevent dupes going forward."?

R Neil Haugen
Legend
January 26, 2017

The whole sentence is:

"After reading through this guide: Reuse clips and work across multiple projects | Adobe Premiere Pro CC tutorials I think we've figured out how to prevent dupes going forward."

There are two video tutorials on that link by Max Jago, a very good teacher of video-post. Have you checked those out?

Neil

Everyone's mileage always varies ...
Inspiring
January 26, 2017

I know & I did: these videos did not answer my problem. He does have a great tutorial for bringing in new clips, and help if you WANT duplicate clips, but these videos do not tell you what to do in case you are getting duplicate clips you don't want.

I do not have "allow duplicate clips" checked.

Kevin-Monahan
Community Manager
Kevin-MonahanCommunity ManagerCorrect answer
Community Manager
April 4, 2016

Hi Mjshade,

is there a way to make Premiere realize that all of our duplicate master clips are the same media and winnow them down without deleting their appearances on our timelines?

I don't believe so. All these imported clips have different XMP IDs, so that Premiere Pro thinks that they are not related to each other. You need to enable writing XMP ID on import before you even begin the project so that Premiere Pro can track what's what. Otherwise, I think you'll have to live with this anomaly, which I agree, can get quite nasty.

I'm writing up a workflow doc to assist others in a "shared projects" workflow, but I'm afraid most of the time a situation like yours occurs where you get the info too little too late.

If anyone else has ideas, I'd like to hear them.

Thanks,

Kevin

Kevin Monahan - Sr. Community and Engagement Strategist – Adobe Pro Video and Audio
veniceedit
Participant
May 18, 2016

How can we view and check an XMP ID to ensure it is the same between projects? I have a similar issue, but only half of the clips created duplicates, while the others linked just fine.