Skip to main content
Inspiring
May 21, 2012
Answered

Any way to prevent dupes in Premiere Project file?

  • May 21, 2012
  • 13 replies
  • 45771 views

Due to working with both PluralEyes as well as multiple editors on the same project, I deal with importing a lot of XML and PRPROJ files into existing project files that I've worked with.

This, on a large scale, becomes untenable because every time I import another editor's work or a synced sequence, I get duplicates of all my media in the project. I'm trying to figure out if there any way to have Premiere check to see if the media is already imported, and reference that media in the imported sequence? If not, I will just keep getting larger and larger project files with multiple references to the same media, because both me and my other editors are working with the same media, but for different sequences.

As far as I can tell, when you import an XML, or even a sequence from another Premiere project, it creates new master clips for every clip used in the imported sequence. It does not recognize that you may already have a master clip that you're using in another sequence that is referring to the same media.

So if you want to keep both sequences in your project, you need to keep both master clips. If you delete a master clip from your bin, it will not stay in the sequence(s) that refer to it, it will get cut out, leaving a big steaming crater where it once was. Even if the sequence is not currently open. This is one of the things I loved about FCP7. You could delete every single one of your master clips and your sequence would be totally unaffected. You could even recreate the master clips by dragging them from your sequence to the bin.

I think if there really is no way to manage these duplicates, this is a HUGE problem for professionals who are working in environments with multiple editors. This isn't just a "well, learn how to deal with a new editing system" - this is actually a deal-breaker; and actually the only one that I see REALLY preventing Premiere from being the go-to choice for larger post houses. This problem becomes so big so fast that it makes true collaborative editing downright impossible. In my office we might have three people on a project, all editing and revising segments and passing them back and forth. On FCP7 this was easy as pie - we'd just cut and paste between project files and use basic versioning best practices. In Premiere, our project files quickly become nightmares and work is often inadvertently deleted or lost.

I would like to see:

- Smart media handling when importing sequences and projects. Premiere should look at the filenames and file location and attempt to relink any duplicate media. If it stumbles, it should ask for help like FCP.

- A media consolidation inspection feature. I'd love to see an option for inspecting your project for duplicate media references. When found, Premiere should automatically consolidate.

- Streamlined sequence exporting. You should be able to export a single sequence. I know there's some version of this in Project Manager, but we all know it should be easier than this!

Anyone have any ideas on how to fix this?

    This topic has been closed for replies.
    Correct answer Kevin-Monahan

    Experiencing extreme frustration with this even in CC 2015!!! Have filled a bug report, I really hope this can be addressed soon!!!

    Hi Darius,

    Please file your specific frustrations here in a bug report.

    Hard for me to convince large productions to make the switch to Premiere when little silly things like this still exist...

    You can avoid duplicates in many cases, but you have to start each project with a few things in mind, especially if working in a collaborative environment.

    • There will be one "master" project for each production that you are working on. This project is read/write.
    • You import other projects from other collaborators via inspecting the project file itself via the master project's Media Browser (you can open multiple Media Browser and save multiple favorite Media Browsers). These projects will be read only.
      • These items can be sequences, graphics, music, etc.,
    • Prior to beginning work on the master project, make sure that you enable 'Write XMP ID to files on import' in Preferences > Media.
      • This will tag each piece of media with a unique ID, which Premiere Pro can track.
      • Then the application will recognize duplicate clips and avoid displaying them.
      • If a clip, graphic, or other media reference does not yet exist in the master project, a clip item is imported to establish a master clip.

    You can tell the "large productions" that this is the method used by both the Fincher and Coen Brothers editing teams. If you have any questions, please let me know.

    See this tutorial for the workflow:

    Thanks,
    Kevin

    13 replies

    Known Participant
    November 14, 2017

    The thing that is killing me is I didn't have this problem in CC2017 but now with an "upgrade" to 2018 I do. How does that make any sense.
    In my case I'm not working with multiple editors or project files (just me) but syncing with Plural Eyes 4.

    I put my media I need synced on a timeline -

    I export the XML for that timeline -

    I imported and Sync that XML in Plural Eyes -

    I export the synced XML from Plural Eyes -
    I imported the new XML into Premiere

    AND IT DUPLICATES THE FREAKING MEDIA.
    Using the Plural Eyes extension gives me the same problem.

    I have "allow duplicate media blah blah blah" unchecked.
    I have "Write XMP ID to files" checked

    This is so so stupid and causing me so much grief. Get it together Adobe, don't release an update that breaks something that wasn't broken before.

    Kevin-Monahan
    Community Manager
    Community Manager
    November 16, 2017

    Jaw,

    Sorry for the frustration. I'm sure you heard this before, but, whenever you are tempted to say, "get it together Adobe" or something like that, what you really want to do is file a bug rather than vent. Sorry, we are in support here and can only triage existing issues. We cannot address quality issues.

    Could it be that PluralEyes needs to be updated? Are you running version 4.1.4? You need to be with CC 2018.

    Thanks,
    Kevin

    Kevin Monahan - Sr. Community & Engagement Strategist – Pro Video and Audio
    Known Participant
    November 16, 2017

    Kevin I know you have to deal with the bulk of our rants and complaints here and that is certainly unfair to you but I'm sure you can understand why so many users get frustrated with these products so often. Collectively we pay Adobe a lot of money and yet with each new "update" (the supposed reason we are paying monthly fees for this software) new things are broken, new bugs and new problems show their heads. It is incredibly frustrating to pay for a such an unstable product. Every other day I'm presented with a new issue, a new error in Premiere. And all I want is for it to work.

    as far as my issue is concerned can you explain to me what good filing a "bug report" would do? surely there have been others that have filed the same or similar reports, how does my adding to it increase the likelihood that the issue gets fixed?

    And yes, I am running the most current version of Plural Eyes.

    CharacterZ
    Participant
    May 19, 2017

    May 19, 2017

    My concern was working with a second editor in another location, but having too much media to put online, as well as having duplicate files when importing sequences (and already having worked extensively on the project before needing a second editor - so we couldn't go back and write XMP ID to files on import.)  It looks like within the team project, the editors can connect to identical hard drives and share material.

    The above answer with a link to:

    Manage media across multiple projects:

    https://helpx.adobe.com/premiere-pro/how-to/reuse-clips-multiple-projects.html

    can be followed up with the below links. I'm about to try it, but it looks like it should work. Just wanted to share the info.

    It is still in Beta and was released in April 2017.

    Collaborate on shared video projects (team projects)

    https://helpx.adobe.com/premiere-pro/how-to/team-project.html

    Working simultaneously in shared projects

    https://helpx.adobe.com/beta/team-projects/using-team-projects.html

    Team project tutorial:

    http://www.adobe.com/creativecloud/team-projects.html

    www.adobe.com/go/teamprojects

    Cheers,

    Z

    Participant
    November 15, 2016

    I found something that worked for me.

    I found the project that didnt have any dupes(about 10 edits prior) and then imported the sequence into that original project.

    Participating Frequently
    May 31, 2017

    Hi Nicholp15321510,

    Any tricks here? I can't seem to get this to work for me, even though I have an older project without duplicates to work from.

    Thanks,

    S

    Known Participant
    April 12, 2016

    I'm on the latest version of CC2015 and OSX. I've been dealing with the duplicate master clip issue for a long time now, and after doing a lot of research, here's what I'm about to try:

    I'm creating a completely blank project file. I'm checking the "Write XMP ID" option and setting my media cache files and media cache file database folders to my external hard drive (this is necessary since my drive gets handed off between editors using different workstations periodically).

    I'm importing all of our 5000+ media files via the media browser (NOT our existing Premiere CC sequences of our Final Cut XMLs from when the project was begun in FCP years ago).

    Once everything is imported and all of the conforming/peak files are finished, I'll try beginning the import of each sequence and XML file in hopes that I won't get any duplicate master clips.

    Here's my question: once I've done all of this, if it works, how do I continue working simultaneously with my other editor, who will be using a separate computer and separate hard drive? Will she have to copy my media cache folders? How will we move forward as we shoot more footage and import it? If we both import the new footage via our media browsers and then send our sequences back and forth via media browser, will we get duplicate master clips? Should our hard drives have the exact same name and file structure?

    Thanks for any insights.

    Known Participant
    April 12, 2016

    So, I tried what I thought would be a work-around to the problem of duplicate files that I've been having. As I mentioned above, I created a completely new project file, imported just my media, waited for everything to conform, and then tried importing my sequences from earlier project files, just to see if it would create duplicates.

    Unfortunately, I have duplicate master clips when I import my sequences.

    I'm at the end of my rope with this program. I can't go back and edit from scratch - the project was originally created in FCP and we migrated using XML files. Someone. Anyone. Is there a way to work collaboratively within this program after you've already begun editing?

    monkeychicken
    Participating Frequently
    April 8, 2016

    I think I found a solution - similar to post #46 by SoFreshFilms

    (which didn't work for me)


    1. Open source project A from offsite collaborator (who has identical media on a different drive)

    2. Reconnect Media

    3. Save and close project

    4. Open destination project B and import sequence from project A (either by file->import or media browser).

    No duplicate clips! Once Premiere knows where the media is, it doesn't attempt to create new clips in the project panel. At least it looks that way in the tests I've done so far...

    Hope this helps.

    R Neil Haugen
    Legend
    April 8, 2016

    One of the bugaboos I've just learned about is that rather than importing the PROJECT from a collaborator working on the same project ... one should use the media browser to open the project and import ONLY the sequences. Then re-connect them to media as needed. Did not know of that step ... which is a game-changer.

    Neil

    Everyone's mileage always varies ...
    monkeychicken
    Participating Frequently
    April 8, 2016

    Yeah, that's what I've been doing but Premiere creates duplicate clips unless I open the source project first and reconnect it to my media and save it. (The source is coming from another editor with a copy of the media on a different drive).

    Matt

    Trelawney57
    Participant
    February 24, 2016

    That's good to know Kevin. We have had a similar issue...Thanks

    February 10, 2016

    Experiencing extreme frustration with this even in CC 2015!!! Have filled a bug report, I really hope this can be addressed soon!!!

    Hard for me to convince large productions to make the switch to Premiere when little silly things like this still exist...

    Kevin-Monahan
    Community Manager
    Kevin-MonahanCommunity ManagerCorrect answer
    Community Manager
    February 11, 2016

    Experiencing extreme frustration with this even in CC 2015!!! Have filled a bug report, I really hope this can be addressed soon!!!

    Hi Darius,

    Please file your specific frustrations here in a bug report.

    Hard for me to convince large productions to make the switch to Premiere when little silly things like this still exist...

    You can avoid duplicates in many cases, but you have to start each project with a few things in mind, especially if working in a collaborative environment.

    • There will be one "master" project for each production that you are working on. This project is read/write.
    • You import other projects from other collaborators via inspecting the project file itself via the master project's Media Browser (you can open multiple Media Browser and save multiple favorite Media Browsers). These projects will be read only.
      • These items can be sequences, graphics, music, etc.,
    • Prior to beginning work on the master project, make sure that you enable 'Write XMP ID to files on import' in Preferences > Media.
      • This will tag each piece of media with a unique ID, which Premiere Pro can track.
      • Then the application will recognize duplicate clips and avoid displaying them.
      • If a clip, graphic, or other media reference does not yet exist in the master project, a clip item is imported to establish a master clip.

    You can tell the "large productions" that this is the method used by both the Fincher and Coen Brothers editing teams. If you have any questions, please let me know.

    See this tutorial for the workflow:

    Thanks,
    Kevin

    Kevin Monahan - Sr. Community & Engagement Strategist – Pro Video and Audio
    lehestro
    Inspiring
    February 13, 2016

    Kevin you beautiful man! THAT is what I've been looking for this whole time! The Write XMP ID preference. At last, a solution! It might have been there the whole time, but there are a lot of people across many forums, including myself, that never knew or could have thought to have used this option.

    evcarpenter
    Participant
    May 10, 2015

    I know I never used to have this problem and I'm not sure why. But what worked for me today was to offline everything in the sequence before I imported it. Adobe imported the sequence and reconnected automatically, no dupes.

    Participant
    December 2, 2014

    So I am migrating a documentary from FCP 7 to PREMIERE PRO CC.  We have sequences with dailies, and editing sequences (using the same media).  We set up the project by character, and inside each character folder is a series of footage folders, as well as a few edited sequences using media from footage sequences.  Making an XML highlighting the entire character bin of footage and sequences, I could import directly into Premiere, but I would get duplicated footage like everyone else on this form, because I had multiple sequences referencing the same media. 

    I was able to skirt the duplicate media "annoyance" when migrating to Premiere by performing a FCP command FIRST before generating XML.  (In FCP, right click on ALL your edited sequences and choosing MAKE SEQUENCE CLIPS INDEPENDENT command.)  Then make sure you make an XML from the entire bin that contains all your sequences.  When importing this XML into Premiere, you can have numerous sequences with same media but it does not import same media multiple times.   

    Participant
    December 2, 2014

    Nice solve for migrating a whole project.


    For passing sequences from one editor to another, here's a workaround we learned today from a shop with multiple editors sharing projects on Premiere:

    Set Premiere's media cache* to the same folder as the media referenced in your XML.** Then import the XML, and Premiere won't duplicate the media on your hard drive, provided the media is in the same folder structure as referenced in the XML. This will relink the media without making duplicates.***


    * Preferences -> Media

    ** The Media Cache may reset itself when restarting Premiere, so it's important to check this every time you migrate a sequence.

    *** Big up to my man Clay for figuring this out.



    Participant
    December 4, 2014

    Great workaround! that made my day!! Thank you for sharing!!

    serrini
    Known Participant
    June 5, 2014

    I believe, my friends, I have found an answer.

    The situation: I have two identical drives. I want to bring a sequence from one project into the other project. Each time, using "import" I would get the sequence, and a bin full of dupe media.

    Solution: move the entire project from one drive to the other. Rename it. Make sure the original drive is disconnected. Open that project. It will not find media automatically. Relink, easy peasy. Save as a different name. Open the other project, do import, sequence, ipso facto, no dupe media.

    Basically you have to relink the media first to the old project, then import the sequence into the new project.

    Janky? Yes. Works? Yes.

    charliew87
    Participant
    July 15, 2014

    Unfortunately the above method did not work for me and tried on several devices. Identical drives and file paths don't make a difference. It's actually the Metadata  In/Out's or markers which probably are causing the issue.  Also although it might seem like no dupe media has imported it will often file it within the same folder as the other project so isn't noticeable all the time. Again you can't even delete said files without it deleting from the sequence. Whilst clearing IN/OUTS from a huge project and its markers every time is too much time when your working in a huge project.

    It's a massive issue for multiple professional users  and one Adobe should be fixing within programme rather than charging for an extra add on like Adobe anywhere, as it's their mistake. They've definitely coded it some way which has them unable to replicate a simple function that the likes of Avid 5 and FCP6 could do, which for me is unacceptable. They also sold it to everyone that CC could do this ( why else would they have allow duplicate media)

    I Spent 4 hours on the phone to Adobe who were surprised that this was happening and when they tried it there end it did the same thing. So appears even Adobe support haven't tested this issue which i find appalling.

    This is my first time on Premiere having used Avid and FCP for many years and although i think it has some really great features  it appears they haven't though about the fundamentals of editing or been bothered to test this across multiple systems.

      Just hope they fix this issue on future updates

    Inspiring
    July 15, 2014

    They are apparently aware of it.  As I told them on twitter (Twitter link here) it's a fundamentally important issue.

    Even the new methods of importing still create duplicates when it's merged clips you're importing... which is a lot of my material. 

    We simply need the ability to delete media (audio and video clips) WITHOUT them being deleted from sequences within a project.  Editing a feature-length doc, my projects are already big and take between 30 and 60 seconds to save.  You can imagine how a prudent autosave interval interrupts the flow of editing.  I cannot say how frustrating all this is.

    We don't need Premiere to try and save us from ourselves.  We're professionals and we know what we're doing.