P: Import is creating OS - level duplicate files named (-2) when using Devices rather than Files

[cs_i_say]

Since I upgraded to lightroom classic from lightroom 5.7.1, imports are now importing duplicate images, even though I have checked don't import suspected duplicates. It happens on both my nikon and canon camera images.

[stephiehow]

I'm having the same issue, importing NEW images from a Nikon Z6ii yesterday, and today NEW images from a Nikon D750, in both cases LR is creating duplicates upon import. I'm running 10.2. Screenshot attached, so you can see how they're numbered 1563-2 and 1563. I've been using LR since version 1, and this is a very new problem for me.

[kimballisms]

I am also having this issue with 10.2.  It's importing all my raw files twice.  I immediately filter by filename matching "-2", check that is half the photos imported, and delete those.

[imajez]

@Rick Another user here on latest version and having a complete nightmare with duplicates being imported/created this last week. So very much time is being consumed by this. 
It's happened multiple times too, even after having cleaned up dupes and along with another new and infuriating bug where LR suddenly can't find the images it just imported if you rename folder, the programme is becoming almost unusable. 
It's also just spent 45+ mins images importing images from my iPhone, most of which I already have in LR, making my maxed out 16" MBP scream like a banshee in process. And that's just importing, not even making previews. 
It's stuck here and now not importing many of the new images, after duplicating yet again a few hundred that are already in catalogue. MBP is still making a racket.

I cancelled import and got this...

I'm wondering if LR now not playing nicely with iCloud? 
I use laptop when away from home and images are placed in a folder than syncs to iCloud. 
Didn't have this problem this time last year when I first set iCloud up to back up my data. 

[FeedbackCommunityMember]

Also having the same issue. Software is up to date as well.

[FeedbackCommunityMember]

@Rick the update did not fix the issue.

[steveg40920317]

I'm having the same issue.

I tried reporting it to Adobe but they just treat it as user error and are completely deaf to the fact they actually might have an issue with their software. They've told me that no one has reported this issue. The number of people on this thread would suggest overwise.

TBH the whole Adobe customer service experience is the worst I've experienced for any service.

[FeedbackCommunityMember]

Same problem here with duplicates plus frequent crashes when open the map module 

[FeedbackCommunityMember]

Im having this issue. I have to cancel the import and start over. 
 So it’s clearly a software issue not a setting issue. 
“ we can’t recreate the issue “ means “ we have no idea “ 

[FeedbackCommunityMember]

Hiya - had the same folder duplication upon import issue and think I found a fix (that works for me at least):

When importing, in the Destination panel, under Organize, I used to select "By date", but when I instead choose "Into one folder" it seems to take away the duplicate folder issue.

Hope this might work for anyone else with the same problem. I've attached screenshots for reference. Not sure if the same fix will work, but I'm so glad now I don't seem to have the duplicated folders in my catalog.

[FeedbackCommunityMember]

Hi all, maybe this could help as a workaround:

I have the exact same behaviour with the duplicates shown before I import (using LrC release 10.2 on latest MacOS). But, eventually, I found out that the duplicates are only shown when I select my CF card (or other media) listed under 'Devices' in the import screen. Below, the same device is listed again under 'Files'. Select the folder on your card where the files are stored, and you see the "true amount" of files. Now you can even go back to 'Devices' and the correct number of images is listed. It almost looks like Lr interprets the two paths as two sources.

Works for me, hope this helps others too 🙂

Kind regards, Nils

[FeedbackCommunityMember]

Same issue - files are downloaded twice and appended with -2.  For files that are named -2, -3, then -4, -5 are added, making this a complete nightmare.

Mac Os 11.3.1

Lightroom Classic 10.2

Happens regardless of camera (Nikon, Fuji).  Have never experienced this problem with previous versions of Lightroom.  

Some additional info - I can tell this is going to happen when importing from a card.  Using Finder, as an example, I can tell there are 1,328 photos on a card.  Then when I use the import function on Lightroom, Copy New Photos, the file count at top right says 2656, an exact double.

Restarted Lightroom and it now shows 1328, no duplicates downloaded.  So this is an intermittent problem and I can't say exactly what triggers it.

[FeedbackCommunityMember]

I often get pop-ups from Adobe asking if I'd recommend to a friend - and the answer is no!

This issue highlights why.  Errors are reported and the response is always "it will be fixed in the next release" and it seldom is!   I have duplicates in Lightroom, the Zoom bug in Photoshop, and the random crash and fail to restart issue in Photoshop too......several updates later, several promises later, still no fix.  

It really is shocking considering how much they charge.

[FeedbackCommunityMember]

Is this issue being addressed? Running LR Classic 10.2 PC.  Culled a bunch of mixed RAWs (many as-yet unimported, many that I KNOW are already in the library that's open), and starting the Import process.   Images that I KNOW are already there are checked/not grey for import.  I'd rather not import 5000 duplicate images.  How do I resolve this issue?  Thanks.

SteveB

[hani7up]

This is totally unacceptable from Adobe! I am a Photoshop and Lightroom trainer and have always defended Lightroom's great capability of organising images in the Library module, especially when someone comes up and praises C1 (which I tried for 3 months and then had one of two choices: forget about C1 or give up on photo editing. I chose the former). 

I am using a Mac mini, M1, Big Sur 11.3.1, Lightroom !0.2, and still getting this absolute pain in the neck importing doubles.

And honestly, I am not paying Adobe in order to spend my own precious time experimenting and trying to solve issues. This is Adobe's genius engineers's task, NOT MINE.

So brace up, Adobe Lightroom software gurus. Do your job and give us a once and for all solution!

[Chair_Pear]

I'm still having this problem and have been for months. Mine also come as duplicates with -2 at the end. I'm importing to a Mac running the latest OS, and my Adobe software is all up to date. 

[FeedbackCommunityMember]

Having the same problem here.  Does anyone know if there is an easy way to delete the duplicates.  I took 455 pics yesterday and now have over 900

[vertizonphoto1]

I just finally realized it wasn;t me! I am having the same issue. Started after last update. MAC Big Sur 11.2.3, LRC version 10.2. TOTAL hassle. Is there a fix?!?

[vertizonphoto1]

Also - I noticed it takes FOREVER to import images now - many hours for what used to take 30 min. 

[vertizonphoto1]

@RickK Like What, Rikk? We're importing and it'd rendering duplicates!?!? Tell me what "steps" you need and I'll gladly supply them. Plug in card - open LRC - click "import" - Select card as source - see settings in screenshot - click "Import".  Seems pretty straightforward.  Camera is a D850 but clearly it's happening across camera brands.  MAC OS Big Sur 11.2.3 LRC 10.2 This started with the 10.2 update I believe.  ALSO NOTE: I have "rename files" checked here but normally don't. Unfortunately, when it's checked, the files got names squentially, so it's even harder to extract the dupes to delete them. Otherwise, they all have a "-2" as others have founds, and they can easily be deleted by do a catalog search for "-2", marking them for deletion and then deleting from disk. 

[michaell78360836]

I am also seeing the same double files with the 2nd version -2. So I have just turned a days work of 1000 photos into 2000 photos.

I noticed top left during the downloading from the card it says ' 2 operations in progress'.

Someone commented earlier in the post that LR could be taking the files from the card by 2 routes...could it be a clue Adobe?

iMac, Big Sur, LR Classic 10.2

[Rikk Flohr: Photography]

For those on this thread experiencing this problem, does the following scenario apply? 

Dual Camera Cards

Shooting simultaneously to both cards

Import to Lightroom Classic by connecting camera to computer via  cable

Do not import suspected duplicates

[foggyboggert]

That is not the case for me. I have a camera with dual cards, but I am not shooting to both, just one with overflow to second card (never used both cards cuz first card is huge). I import using a card reader with only one card inserted. Importing gives duplicate files with "-2" appended to file name.

[foggyboggert]

Maybe until you can solve this issue, give us a utility for deleting duplicates. Someone who knows Python or shell script could do this in about ten minutes. (Any users want to step up?)

[FeedbackCommunityMember]

I ran into this problem earlier and am now left with thousands of duplicates after a large import from an iPhone.

 As @Rikk mentioned above:

The exact criteria for Classic is  File Size/Filename/Capture Date. If all three match it is a duplicate. If they do not it is not treated thusly. If you rename when importing this will make the duplicate check fail on Filename.

This is cheap to do, but not very robust. Hence...

Feature Request -- Content-based duplicate detection, review and deletion workflow.

• As a LR user I want LR to automatically detect duplicate images and videos in my catalog based on the image or video content, not just the filename / metadata.
  
  • The content analysis processing should run in the background whenever LR is running.
  • LR should provide some way to see whether the analysis is complete.
• I want LR to provide a UI where I can view all detected duplicates.
  • The UI should show the image / video thumbnail alongside the detected duplicates.
  • The UI should also display, for each image/video relevant metadata, including:
    • The filename and the location of the image/video in the catalog.
    • The capture date/time for each image/video.
    • The import data/time for each image/video.
  • The UI should clearly highlight differences in filename or metadata (e.g. with color or other visual cue).
• The UI should allow me to bulk select and delete duplicates
  
  • Convenient bulk selection shortcuts should be provided, e.g. "Select most recently imported" or "Select all but oldest", etc.
  • Once selected, I should be able to delete all the selected files.

It would be fabulous if the LR team would implement content-based duplicate detection. Obviously this isn't trivial with a large catalog but the benefit to me would be huge.  It would save me a ton of time not having to find and remove duplicates in my catalog which has over 150K images.

I am aware that there are plugins out there that claim to remove duplicates, but I don't feel confident in using any of them.  I would much prefer that this functionality come directly from Adobe and be included as a feature in LR.

I apologize if this is not the correct way to file a feature request.  I did look for a feature request portal but it appears that the old one is retired.  Please let me know if there's a better way to file this request and I'll gladly do that. 

[FeedbackCommunityMember]

I'm also having this problem. Trying to import a bunch of photos from phone. Some were already imported. Filenames weren't touched, so the files should be identical, but Lightroom want to import them anyway. Using v10 on Windows.