Odd problem: revert current catalog, that includes dng, back to raw/camera original directory on HDD

[brimurphyphotog]

I'm working with recent(and last) version of LR Classic, external hard drive, and mixed file types: cr2, jpeg, dng. LR catalog lives on macbook sdd and image files live on external hdd.

Midway through converting cr2 files (already cataloged/living on sdd), I realized they were doubling in size as they overloaded my disk space. Found other adobe forum users who've done this that probably shot either sRaw or mRaw in camera making this conversion not optimal for quality and disk space.

What I've tried: I properly pointed the most recent version of my catalog to the identical (aside from ~2000 .dng files) file directory on the external drive I planned on using after dng conversion was complete. The location was updated for my entire catalog. The files have the .dng extention in LR even though they are "recognized" as cr2. They show as previews with metadata (mainly flags).

I tested a potential solution with a small folder by doing synchronize folder>reimport from new location. The entire folder disappeared from catalog.

All I really need from them are the flags. What should I try next?

[Laura Shoe]

I don't understand this: " I properly pointed the most recent version of my catalog to the identical (aside from ~2000 .dng files) file directory on the external drive I planned on using after dng conversion was complete. The location was updated for my entire catalog. The files have the .dng extention in LR even though they are "recognized" as cr2. They show as previews with metadata (mainly flags)." 

Please elaborate, stating what you did at each step and why.

Regarding Synchronize, I'm betting that that folder was missing (had a question mark on it) or all the files in it were (with exclamation marks.) In the Synchronize dialog the  "Remove Missing Files" box was checked, so LR removed that folder.

If you're trying to point LR to a different source for your files, then right-click on the folder and choose Update Folder Location, navigate to the new source and select it.

[Rob_Cullen]

My 'take' on your problem, as I see it.- (it may be helpful, or not)

I'm working with recent(and last) version of LR Classic, external hard drive, and mixed file types: cr2, jpeg, dng. LR catalog lives on macbook sdd and image files live on external hdd.

Midway through converting cr2 files (already cataloged/living on sdd), I realized they were doubling in size as they overloaded my disk space.

Using [Copy as DNG] at import does not "double" a single file size. The DNG will be smaller than the original CR2.

Using [Copy as DNG] from a hard-drive at import does first make a copy of the CR2 and then converts the copies to DNG, so you now have two files (that both may exist on the hard-drive).

If you use the Adobe DNG Converter program, then it can embed the original CR2 within the DNG and definitely make the one DNG file twice the size of the CR2, or leave a copy of the original in the original folder, depending on the options chosen.

What I've tried: I properly pointed the most recent version of my catalog to the identical (aside from ~2000 .dng files) file directory on the external drive I planned on using after dng conversion was complete. The location was updated for my entire catalog. The files have the .dng extention in LR even though they are "recognized" as cr2. They show as previews with metadata (mainly flags).

DNG and CR2 files are NOT recognized as the 'same' files by Lightroom. You cannot 'update' the folder location from a folder of DNGs to a folder of CR2s. So you cannot "point" the Lightroom folder to the original CR2s.

I tested a potential solution with a small folder by doing synchronize folder>reimport from new location. The entire folder disappeared from catalog.

Yes, as stated by Laura, if folder was 'pointed' if shown as "missing" then it would indeed remove photos (and the flag info) from the catalog.

And the "Dangers of Synchronize"-

https://www.lightroomqueen.com/synchronize-folder/?utm_source=The+Lightroom+Queen&utm_campaign=66f3d...

All I really need from them are the flags. What should I try next?

After the mixup, (and deletion of the DNG folder) I think your only recourse now might be to recreate the folder of DNGs (by converting with the Adobe DNG converter) and recover the "flags" you need from a backup catalog that has that info about the DNG versions.

I think It might be simpler just to start again and redo the flagging. (The 'Spray Can' can speed up that process!)

[brimurphyphotog]

WobertC  wrote

After the mixup, (and deletion of the DNG folder) I think your only recourse now might be to recreate the folder of DNGs (by converting with the Adobe DNG converter) and recover the "flags" you need from a backup catalog that has that info about the DNG versions.

I think It might be simpler just to start again and redo the flagging. (The 'Spray Can' can speed up that process!)

Yes, so very clear and helpful, thank you! I used the Adobe DNG Converter program in LR, but I did not check "embed copy of original file." So it must be the copy of the original in the original folder, as you stated.

Could you please elaborate on the above suggestion? I initially did make a virtual copies collection of all .dng files, then exported them together as a catalog just in case. Might that have something to do with your solution?

I've done a start over, pen/paper log process from a prior self-inflicted catalog error but am hoping there's a work around to avoid a repeat of that tedious experience   Also, "Spray Can" ??

[Rob_Cullen]

I used the Adobe DNG Converter program in LR, but I did not check "embed copy of original file." So it must be the copy of the original in the original folder, as you stated.

The Adobe DNG Converter program does not exist "in LR".  It is totally separate software that runs independently. If you used this you would definitely know it.

The Lightroom option to "Copy as DNG" in the Import dialog does not have any 'options' or anything you can set- it simply copies your Cr2 files from a camera card, or another folder on the hard drive, then converts the copies to DNG. So if you used this option to Import files from the Hard-drive then you would have two versions of your files- CR2 and DNG, in separate folders.

(You can also convert a folder of CR2s to DNG from the LR menu, but that is another 'road to go down' )

Could you please elaborate on the above suggestion? I initially did make a virtual copies collection of all .dng files, then exported them together as a catalog just in case. Might that have something to do with your solution?

I am not sure what you achieved by this, or what your result was! Virtual Copies (LR nomenclature) are not 'physical' files, they are only another version of LR edits recorded in the catalog. And an exported catalog will do nothing to restore the catalog links to the original CR2 files if they are shown in the catalog as DNGs.

I've done a start over,

So then it is a Re-flag job.

pen/paper log process from a prior self-inflicted catalog error but am hoping there's a work around to avoid a repeat of that tedious experience   Also, "Spray Can" ??

The "Spray Can" is the Painter Tool that appears on the lower Tool Bar (if it is checked 'on' in the Tool Bar options)

When the Painter Tool is selected you can set it to 'Flag' photos. Just a "squirt" (click the left mouse button) on any photo in the library grid will apply the option you set. You can also Click and Hold the mouse button as you drag ("spray") the Painter Tool across multiple photos in the grid to 'flag' them all.

   

[brimurphyphotog]

I apologize for not making clear that these photos were converted to dng after I'd imported them into LR. I used the filter dialog to select all CR2 files then this:

That began the conversion with these settings:

Doing this brought my hard drive to less than 1gb of space and LR automatically stopped the conversion process. And yes, I did try keeping up with emptying the trash to free disk space. Here is a comparison of the get info dialog boxes of a converted dng and a cr2. They are the same shoot imported together from the same memory card.

Yes I absolutely have multiple backed up copies of all original files stored on different external hard drives. That is what I meant in my original post with

"I properly pointed the most recent version of my catalog to the identical (aside from ~2000 .dng files) file directory on the external drive"

This external drive has only the CR2 files NOT the DNGs.

The most recent backup catalog that doesn't have .dng files does not have A LOT of work I did both in Library and Develop module on other photos so unfortunately not an option for me.

My aim is to find a solution where I'm not reimporting and reflagging through couple thousand photos. But if that is necessary I'd like to export the filenames of the flagged photos so that I don't have to go through and write each flagged file name down.

This thread gave me an idea for that I believe you've toyed with in this thread...How to export a list of selected file names to share with a collaborator or client  what are your thoughts?

[Rob_Cullen]

I'd like to export the filenames of the flagged photos

For a Filename list, John Beardsworth has a Script that is very easy to use, and is fantastic for that purpose. (Better than 'ListView' for a simple text list)

Filenames – Lightroom Solutions

To use-

In the LR library- Use the 'Attribute' filter to show flagged photos, select them all [Ctrl+A], click "Get Filenames" from the Script menu.

[brimurphyphotog]

Thank you for all of your time and help. My apologies again for the confusion! Will work on that next time I post in a forum

[elie_dinur]

Wow! How to make something simple into something complicated. If you have made an irreversible mistake in your catalog and you have a very recent backup without the mistake, logic says trash the catalog and replace it with the backup - that's what backups are for.

If you changed the nature of your image files and then changed your mind, you better have backups of them also.

1. Close LR.

2. Navigate to catalog location. Delete *.lrcat file or for safety's sake move it to your Desktop for later deletion.

3. Navigate to backups location. Unzip most recent and copy .lrcat.

4. Return to master catalog location and paste the b.u. exactly where the spoiled one was. Check that the name of the new .lrcat file exactly matches the name of the Previews.lrdata folder.

4a. Replace the dngs with the originals.

5. Launch LR.

[Rob_Cullen]

Wow! How to make something simple into something complicated.

@eli_d Your 5 steps are excellent, and I agree with them, but as I see the OPs problem it is not simple.

Without sitting at the OPs computer it is difficult to get the 'full picture'.

4a. Replace the dngs with the originals.

This would be so simple IF the OP has a backup copy of the CR2 files, and the catalog, but this has not been stated, so the belief was that only the converted DNGs exist. And the conversion from CR2 to DNG was interrupted (at what stage?) to also complicate recovery in the catalog.

and -basically a recovery from backups (if any were created?) seems remote because of the statement-

by doing synchronize folder>reimport from new location. The entire folder disappeared from catalog.

All I really need from them are the flags.  Also, "Spray Can" ??

It seems the OP could benefit from advice on easier methods of flagging photos.

[elie_dinur]

Yes, you are right. I guess I automatically (mistakenly) assume that someone who has catalog backups would have backed up the most important element, the image files.