Skip to main content
Z
zefelder
Known Participant
January 20, 2022

P: Duplicate detection fails when Filename/Size/ Match but Date does not

  • January 20, 2022
  • 8 replies
  • 2524 views

I just was importing ~480 photos and I noticed that 6 or so of these photos were grayed out because they were "suspected duplicates".

 

They are definitely not duplicates. I made these photos today. I checked that the catalogue does not have any old photos incorrectly stamped with today's date.

 

I would assume that suspected duplicates at least involve comparing hashes of photos. For 6 out of 480 false poistives it should be a very weak hash even taking in account that I have ~300K photos in my catalog. So really sounds like a bug for me. Also I don't remember seeing anything like this in ~10 years that I use Lightroom. 

This topic has been closed for replies.

8 replies

Rikk Flohr_Photography
Community Manager
Rikk Flohr_PhotographyCommunity Manager
June 14, 2022

The SDK will be updated later this week (June 13). The update contains a fix for this issue.  Please download and the latest version of your application via the Adobe Creative Cloud Application or your respective device app store.

If you do not see the update (Mac and Win) you can refresh your Creative Cloud App with the keyboard shortcut [Ctrl/Cmd]+[Alt/Opt]+[ R ]. 

 

Note: App store availability can take several days for the update to appear and be available. 

 

Thank you for your patience.

Rikk Flohr: Adobe Photography Org
Z
zefelderAuthor
Known Participant
April 14, 2022

Note that this bug is reproducible at least in Lightroom Classic versions 11.1-11.3 in Windows 10, Windows 11 and macOS Monterey (12.3.1). I believe I also reproduced it in 10.3 a while ago.

Z
zefelderAuthor
Known Participant
April 13, 2022

I could not reproduce this myself using the links that I sent to you.

 

BUT!

 

I could reproduce it using the original files. It also reproduces on the latest version 11.3.

I found that if I upload the RAW file to Google Drive and download it back, the issue does not reproduce anymore. Moreover if I simply zip this file and unzip on my computer, the issue does not reproduce. However if I compress it as rar, upload, then download and uncompress, the issue reproduces. It has to do something with file metadata, but not something that can be checked in windows explorer (file properties), as I don't see difference there in file size, dates, or attributes.

 

In order to send this RAW file intact to you I am sending link to a RAR file which contains it. If you can suggest another way of sending it *intact* - I'll do anything you'll ask.

 

Please fix this bug...

Rikk Flohr_Photography
Community Manager
Rikk Flohr_PhotographyCommunity Manager
April 11, 2022

We are unable to reproduce this now using your test catalog files.

 

Request from Engineering: 
"Is it possible to get the system info of the user or screen recording for  the same?"

 

Is it possible for you to provide this?

Rikk Flohr: Adobe Photography Org
Rikk Flohr_Photography
Community Manager
Rikk Flohr_PhotographyCommunity Manager
January 25, 2022

Thank you. The files will be internal to Adobe.

This thread will be updated when a fix is issued. There is no ETA. 

Rikk Flohr: Adobe Photography Org
Z
zefelderAuthor
Known Participant
January 25, 2022

Yes, you can include the files in the bug report. I assume it is internal to Adobe.

 

How can we learn about the progress on fixing it? I'll have to change my workflow till it's fixed so that I don't lose photos.

 

This affects many unaware users in the same way (some photos suddenly don't get imported, lost forever on card reuse). Thus sounds like a high priority bug.

Rikk Flohr_Photography
Community Manager
Rikk Flohr_PhotographyCommunity Manager
January 24, 2022

Setting status - adding bug number for cross-reference. 

Rikk Flohr: Adobe Photography Org
Rikk Flohr_Photography
Community Manager
Rikk Flohr_PhotographyCommunity Manager
January 20, 2022

Curious - are these Drone Photos?

 

LrC views duplicates like this:

 

If: 

  1. Photo is the same physical size on disk
  2. Has the same Date/Time Stamp
  3. Has the same file name

It is a duplicate.

 

Select a file from your import queue - see if your Lightroom catalog has another file of the same name by searching All Photos for that file name. Compare the Date/Time and Size on Disk. 

Rikk Flohr: Adobe Photography Org
Z
zefelderAuthor
Known Participant
January 21, 2022

No, these are not Drone photos. The photos are from Sony ZV1 (a variant of RX100).

 

I checked that I don't have any other photos with the same date - checked both file creation date and EXIF.

 

Given I have tons of photos in the Catalogue there could be collisions by name+size alone (there on average ~50 identically named photos, and sizes are not very different either). Unfortunately I did not write down the names of the photos that were marked suspected duplicates before I imported them, so unfortunately I cannot provide more specific information. But I do suspect a bug, as I don't see any other reasonable explanation.

 

Rikk Flohr_Photography
Community Manager
Rikk Flohr_PhotographyCommunity Manager
January 21, 2022

As a test...

 

If you restart your computer and create a new blank catalog and attempt to reimport the 480 photo batch, what happens?

Rikk Flohr: Adobe Photography Org
Terms & ConditionsAccessibility statement
Using the community Terms of use Privacy Cookie preferences Do not sell or share my personal information ad choicesAdChoices