lrcat-data file is too large and very slow to copy, causing very slow backups
The Lightroom Catalog now has a sidecar file called 'lrcat-data', which I understand stores data calculated from AI operations such as masking and denoise.
Since the denoise feature was updated to store the resulting data in the catalog instead of a DNG file, the size of lrcat-data has ballooned to unreasonable size for many users, myself included. Given we can only expect this to grow, Adobe needs to give us options to better manage this, such as manually or automatically deleting this data from the catalog similar to how previews are handled. If the data is needed again it can be recalculated or loaded from sidecar files (storing it in sidecar files is already supported). I expect this is already in the works.
But there is another issue which I don't think has been raised, which is that the lrcat-data files is structured as some sort of blob archive and, at least for me, is very very slow to copy. You can reproduce this by copying the file on to a fast external SSD, and compare the transfer rate to copying files like large media files or even the lrcat file. The transfer rate is significantly slower for the lrcat-data file, compounded by the fact that it is very large. I believe this is because the file system sees it as a folder with many small files, which have much higher overhead when copying, but regardless of the reason it is very frustrating.
Most importantly this seems to affect Lightroom backups - currently backing up Lightroom takes an unreasonable amount of time for me, and I believe it is due to the slow copying of the lrcat-data file. This should be easily fixable by wrapping the file in a tarball or with any number of other solutions sutiable for backup purposes.
Please fix this, being able to back up our catalog files seamlessly is very important and should be made a priority, even if it takes longer to address the file size issue itself.
[Moved from ‘Bugs’ to ‘Discussions’ by moderator, according to forum rules. This is a real issue, but obviously not a bug.]
