P: Import is creating OS - level duplicate files named (-2) when using Devices rather than Files

I am having the same problem. Duplicate file with a -2 file name.

Mac 11.4

Nikon 780

Lightroom C 10.3

Kingston card reader

@Rikk 

I was only using  single card

Connected to LR using a SD card in a CalDigit box and thunderbolt cable to IMAC

I did not have 'do not import suspected duplicates' checked.

Just turned 880 files into 1760 files 😞

Been noticing a similar issue although a little different from some of the above.

Camera: Nikon D-850

Card Reader: Sony XQD / SD XCII 

Card: Sony XQD G - 64 GB

Updated LR Classic 10.3

Seems to only happen on these cards and when importing with hardware above.  Doesn't happen with my D 750 or SD cards...

When I import - LR imports two copies of each file but names them differently.  Looking at metadata - the reserved name of the original file on the card is (for example) DSC_7628.  When import is done there are two files that both have my custom name (I typically name files based on date taken and topic) but very different extended numbers:

1st import:  20210601-Custom Topic-2-1 (The next file will be 20210601-Custom Topic-2-2 etc). This assignment of "2-1", "2-2", etc comes from somewhere - not me.

2nd import: 20210601-Custom Topic-7628 (this is what expect to see typically).  

I do note that looking at meta data - the first import is just the NEF where the 2nd import shows the NEF file and an xmp sidecar file.  

Any ideas to share?? 

I've noticed that it's only happening to me when using a certain Sony M SD card, not withstanding that it gets formatted daily after use. I also have another Sony M SD card that constantly includes/writes a jpg version of a duplicate file, even though using a different card doesn't do that, again reformatting daily. 

Is there some ghost-like invisible stuff happening on these cards? I'm using Sony cards in 6 different camera bodies, with various results based on the card used, not the camera body.

I'm also having this problem. Trying to import a bunch of photos from phone. Some were already imported. Filenames weren't touched, so the files should be identical, but Lightroom want to import them anyway. Using v10 on Windows.

I ran into this problem earlier and am now left with thousands of duplicates after a large import from an iPhone.

 As @Rikk mentioned above:

The exact criteria for Classic is  File Size/Filename/Capture Date. If all three match it is a duplicate. If they do not it is not treated thusly. If you rename when importing this will make the duplicate check fail on Filename.

This is cheap to do, but not very robust. Hence...

Feature Request -- Content-based duplicate detection, review and deletion workflow.

• As a LR user I want LR to automatically detect duplicate images and videos in my catalog based on the image or video content, not just the filename / metadata.
  
  • The content analysis processing should run in the background whenever LR is running.
  • LR should provide some way to see whether the analysis is complete.
• I want LR to provide a UI where I can view all detected duplicates.
  • The UI should show the image / video thumbnail alongside the detected duplicates.
  • The UI should also display, for each image/video relevant metadata, including:
    • The filename and the location of the image/video in the catalog.
    • The capture date/time for each image/video.
    • The import data/time for each image/video.
  • The UI should clearly highlight differences in filename or metadata (e.g. with color or other visual cue).
• The UI should allow me to bulk select and delete duplicates
  
  • Convenient bulk selection shortcuts should be provided, e.g. "Select most recently imported" or "Select all but oldest", etc.
  • Once selected, I should be able to delete all the selected files.

It would be fabulous if the LR team would implement content-based duplicate detection. Obviously this isn't trivial with a large catalog but the benefit to me would be huge.  It would save me a ton of time not having to find and remove duplicates in my catalog which has over 150K images.

I am aware that there are plugins out there that claim to remove duplicates, but I don't feel confident in using any of them.  I would much prefer that this functionality come directly from Adobe and be included as a feature in LR.

I apologize if this is not the correct way to file a feature request.  I did look for a feature request portal but it appears that the old one is retired.  Please let me know if there's a better way to file this request and I'll gladly do that. 

Maybe until you can solve this issue, give us a utility for deleting duplicates. Someone who knows Python or shell script could do this in about ten minutes. (Any users want to step up?)

That is not the case for me. I have a camera with dual cards, but I am not shooting to both, just one with overflow to second card (never used both cards cuz first card is huge). I import using a card reader with only one card inserted. Importing gives duplicate files with "-2" appended to file name.

For those on this thread experiencing this problem, does the following scenario apply? 

Dual Camera Cards

Shooting simultaneously to both cards

Import to Lightroom Classic by connecting camera to computer via  cable

Do not import suspected duplicates

iMac, Big Sur, LR Classic 10.2