Skip to main content
Inspiring
July 29, 2015

P: Wrong timestamp stored in catalog causing wrong metadata status (all Windows versions)

  • July 29, 2015
  • 66 replies
  • 3623 views

Hi,

The problem I describe below is not new (I observed this at least since version 3) but this time I took the time to investigate more deeply...

From time to time, LR tells me that the XMP file of a given image is no longer in sync with the metadata in the catalog. Most often, this is correct because I made changes without recording the XMP file (Ctrl-S - I'm not using the automatic XMP updating mode). But very often, this information is simply wrong. I didn't change anything to the image and suddenly, the little down arrow appears in the upper right corner of the thumbnail.

Hitting Ctrl-S may or may not fix the problem. Sometimes, the little down arrow reappears after a few seconds or minutes although I didn't do anything (hands away from keyboard and mouse).

I recently did the following test for multiple images unduly displaying the "metadata status changed" flag. I compared the following values :

1. Windows "last modified" timestamp for the XMP file.
2. Value of the xmp:MetadataDate field in the XMP file.
3. touchTime column value for that image in the Adobe_images table of the catalog (which is a SQLite database).

The touchTime value is stored in a special format, so I had a hard time converting it to a readable date/time value. However, I will not explain this and how I navigated the database in order to access this timestamp (this requires some knowledge about databases).

Result:
For all the images tested, values #1 and #2 were always strictly identical. The touchTime value was always off (sometimes about 10-15seconds, sometimes much more). So no wonder that LR thought that the XMP file and the metadata in the catalog were not in sync.

Moreover, the difference in time can be negative of positive. So LR displays the up or down arrow accordingly (meaning that the XMP file is older or newer than the metadata in the catalog, respectively - which is wrong in both cases).

I explained above that sometimes, the image reappears as "not in sync" just a few seconds or minutes after I did a Ctrl-S. In that case, a quick look at the database showed me that the touchTime field had not been updated. So the time difference causing the image to be flagged as "not in sync" was still there. In that case, the problem can be fixed by reading the metadata from the XMP file which was actually correctly updated. This operation updates the catalog and everything is in sync again.

Anyway, there's something very wrong in the computation of the touchTime value of the Adobe_images table. That seems to be obvious. This wrong timestamp generates in turn a wrong metadata status.

I made another interesting test :

1. I started from a situation were 0 image was flagged as "not in sync" with the XMP file.

2. I purged all 1:1 previews and started a Build all 1:1 previews.

3. In Library mode, I setup a filter to show only the images that had the Metadata Status set to "has been changed". I got a cup of coffee and waited.

At the beginning of the generation process, no image was displayed in the grid, as expected. While LR was building the previews, images unduly tagged as "not in sync" started to appear. I got about 200 of them. For all these images, the metadata status was just plain wrong. These were finalized images not modified since a long time and for which the XMP file had been timely updated after the last modification. I checked the touchTime field for some of them and each time it was different from the Windows "last modified" timestamp and from the xmp:MetadataDate field of the XMP file as mentioned above.

So now I know what's going wrong but I'd like to have this problem fixed after all these years.

Thanks in advance.

This topic has been closed for replies.

66 replies

Participating Frequently
November 8, 2018
Dear Photoshop-Lightroom development team.
This is a serious flaw and technically can be solved with some basic knowledge. So it might be a good idea to hire some engineers with knowledge in backup software.
Known Participant
November 7, 2018
Yes, I see this in Mojave (and it was present in High Sierra), but I've only seen it with LR7.5 and LR8.
Participating Frequently
November 7, 2018
Same on Mac OS.
SamoreenAuthor
Inspiring
October 16, 2018
Not fixed in LR 8.
--Patrick
ssprengel
Inspiring
September 22, 2018
If this is caused by LR updating something in the metadata, perhaps the metadata version number, as a background process that is scanning all the photos, then it is not a bug.

Do we know what is changing, if anything, by comparing the XMP file before and after a Write Metadata to Files?
SamoreenAuthor
Inspiring
September 22, 2018
Still not fixed in 7.5 but I would be inconsistent if I said that I am surprised. :--((
--Patrick
Participating Frequently
August 11, 2018
IMHO, the LR dev team and their processes (QA in particular) is no where near the quality of the PS development team. Adobe have the capability but seem content on collecting their monthly fees and not delivering what was promised. I am still confounded why no one has not yet brought a class action law suit against them. Someone who owns a business impacted by these bugs surely would be a good lead plaintiff.
SamoreenAuthor
Inspiring
August 11, 2018
Hi Marco,

This bug exists since the beginning of Lightroom and I have been experimenting with the Save/Read workaround a lot. AFAIK, this procedure is safe. Never had a problem with this. However, this fixes the problem only for a (sometimes very short) while. As soon as the files are accessed again (for example when rebuilding a discarded preview), the problem may appear even if you didn't make any change. Just viewing the images is enough.

I am using a single rule dynamic collection (Metadata Status is no up to date) to regularly fix this mess. Open the collection / Select All / Save.

As for a fix by Adobe, give up any hope. The usual rule applies : once a bug has survived one or two years, you can be assured it will never be fixed. They just don't care and this is a demonstration that the bug  doesn't  prevent the product from being sold anyway. High code quality and professional conscience are no longer a preoccupation at Adobe.
--Patrick
MarcoKlompalberts
Participating Frequently
August 11, 2018
By the way, I noticed you can search for (and have smart collections with) metadata status.
It would be handy if you could also search for metadata date. That way I would be able to Save To File and afterwards Read From File if the metadata date is after the last save time
(hope that thought makes sense 😉 )
MarcoKlompalberts
Participating Frequently
August 11, 2018
With all the detective work Patrick has done, you would think that Adobe would at least have a clue where to look for it.
Having the same issue here.
Once in a while, I will save to file, to make sure that everything is in sync.
I will usually select (with smart collections) all photos from 1 year and Save To File.
But I am hesitant to Read From File, because what if the save didn't go as planned?

Really hope that this will be fixed.

I am on a Windows 10 PC with the most recent update of Lightroom CC Classic installed.