FAST exporting, BUT after the export, the images that are added to the Catalog Makes all slow

[geral42131550]

This is a former issue. 

As professional photographers we need to create several versions for our images and be able to see them between our catalog. 

The problem is that the export is so fast, but the adding of the now new images is a dread. It makes impossible to operate lightroom until the process is done.  Imagine waiting 3 secs per image after a wedding export with 1000 images.  That's 3000 seconds,  50 MIN...   It brings the whole efficiency to halt. 

please help this a problem that had been reported before but adobe doens't seem to offer a solution. 

[KR Seals]

Wnat is your disk configuration? All on internal SSD? External SSD? External HD? NAS? If external, what interface are you using to connect to the disk(s)?

What size files are you working with?

What are your Image Sizing settings in the Export module?

[KR Seals]

I had a chance to do a test to compare my results with yours. My MBP is a M1 MAX 64GB, 2TB SSD. All tests were on the internal drive. I am working with 45MP Nikon Z 8, HE* NEF files that are about 32MB each on the drive. I exported to .jpgs, quality 60, 2500 pixels on the long side. I did the export first, then did a folder sync so I could get separate times for the export and import.

My times were:

250 images

Export - 5 minutes 7 seconds

Import (folder sync) 1 min 0 seconds.

Extrapolated to 1000 images

Export 20 min 28 sec

Import 4 minutes

Please answer my questions in my previous post. If you are using the internal SSD on the MBP, it's probably time for a trip to Apple service.

To export

[geral42131550]

Thank you for testing your exporting times.  My exporting times are not the issue.

The issue is after they are created and exported, the images take too long to be added to the Catalog. Is the adding to the Catalog that takes 2 to 3 sec per image.   

The SDD is the intermal one from the macbook. 

[KR Seals]

Those times don't agree with mine. What size are your exports? How much free space do you have on the internal SSD?

Are you actually saying the 2-3 seconds happens as you scroll through the images that were added after the export?

[geral42131550]

Thank you for checking your times.

My SSD is a 8TB. I have space for about 3TB more.  I have 128 Ram. 

Most of my exports are simiple. I start with a 24mp raw file.  They are 6000x4000 pixels. Then my exports are resize to 2160pix the longest side.  The JPG quality about 60%.  I can export them super fast.  50 images export takes about less than a min.  It takes more time to have them added back to the catalog.

[KR Seals]

Just for the fun of it (and troubleshooting) try the Export and Import as separate operations. What times do you get then?

I'm suggesting this because the export times you report seem unrealisticly fast, even for mid size files like that.

[geral42131550]

Sorry for the late response.  Usually export is fast, images are 2000 pix on the long side.  So with an M4 the export speed is no proble. Also the import speed is no problem when the card has 1700 mbs Reading speed and the port is thunderbolt 4.

The issue is when lightroom has to bring the images you exported back into the catalog that becomes dreadfully slow.   

I spent hours on Adobe support last time, chat after chat, each tech needed to start from the beginning with me. Such a waste of time they don't take notes, neither they read them so you are back to square one with them.  

There might be the fact that my catalog is huge,  1. 2 million images.    

It's actually easier for me to "not add the images to the catalog" automatically after export, but to actually just export, and then syncronyze the folder manually.   But the problem with that is that you usually forget. So those files have the potential risk to remain hidden from your catalog.

[Ian Lyons]

I may be misunderstaning the reason for you creating/exporting/importing multiple versions of each image, but would it not be easier to just use Virtual Copies?

[geral42131550]

Thank you, but that's not the issue. No it doesn't work for us to create virtual copies, when several versions are needed.

For Print publication, web publication, different pixe sizes, with watermark etc etc.  Each folder needs to have the files needed so our team members can access the folders they need.

[richardplondon]

Accepting each folder needs to have the files needed - can the team members not browse to, and carry out needed tasks with, that folder and those files directly? This is AFAICT why we export: to create derived image versions, themselves unsuitable for further editing work or changes of management, that will be accessible from outside the Catalog.

On the subject of fast export but slow re-import: is it possible these exports are merely fast to submit for queued processing? If they are then proceeding in the background, that would result in a delay before each file is made and then a re-import of that becomes possible. So this may accordingly present as fast export but slow import.

The way to be sure would be to separate export and import, and to verify in the file system how long it does take before exported files are completed. Then the import speed could be directly checked also. Also computer resources may be fully taken up with queued export processing, likely more computation-intensive than import would be.

[georges66728763]

Can't export pictures by email

[KR Seals]

@georges66728763  That is is different issue than the one in this thread. I suggest you search this forum for that problem and if you don't find an answer, create a new post with full details including your Operating System (Mac or Windows) and the exact version number of your Lightroom Classic.