Lightroom is corrupting the original jpeg files on a NAS. Backups can prove this.

New Here ,
Nov 21, 2017

Copy link to clipboard

Copied

Hi there,

I've just started using Lightroom classic on OSX, and began importing files (add, not copy) from a reliable NAS (with raid6) next to the mac. Something quite troubling is that a lot of my JPEG files are being corrupted by Lightroom, and every time I try to research this I keep finding people dismiss it entirely as "nah it can't be lightroom ever its a bad camera / card reader / hdd, etc" but this simply isn't true in this case. My proof? I can go through all the photos on the file share in osx preview and full images and zoom (not just thumbnail previews) will load fine. I go into lightroom to open the same image as a 1:1 and as the image starts loading chunk by chunk (as it would do on slow network storage) about 30% of those images will show about a quarter of the image and leave the rest blank like this https://i.imgur.com/uLbojxb.jpg . This sucks but the real killer is that it modifies the file on disk, corrupting my original jpeg! This can be confirmed by running stat on the file on the NAS just seconds after loading the image:

adam@edge:/mnt/nas-lv/camera/DCIM/106_PANA$ stat P1060671.JPG

  File: ‘P1060671.JPG’

  Size: 6693376       Blocks: 13088      IO Block: 4096   regular file

Device: fd06h/64774d    Inode: 221320927   Links: 1

Access: (0777/-rwxrwxrwx)  Uid: ( 1000/    adam)   Gid: ( 1000/    adam)

Access: 2017-11-20 21:21:05.800605669 +0800

Modify: 2017-05-18 11:14:58.000000000 +0800

Change: 2017-11-21 15:10:27.379631049 +0800

Birth: -

As you can see, this photo from May, which I had copied over to the NAS that same day, which I imported last night, and went to open the image in lightroom today, it had been modified at the exact moment I double clicked it in Lightrooms catalog. No other programs are accessing the files, and osx-preview had been quit beforehand. Lightroom is corrupting files, not a dodgy camera, not a single hard drive dying

I really want to move to using Lightroom but this is absolutely terrible, it keeps eating my photos. I've had to restore a whole backup of my originals folder from a secondary backup NAS because there's too many photos it has done this to. I would greatly appreciate any advice on this. I've attached a system info below. Thank you,

Adam

System info

Lightroom Classic version: 7.0.1 [ 1142117 ]

License: Creative Cloud

Operating system: Mac OS 10

Version: 10.12 [6]

Application architecture: x64

Logical processor count: 8

Processor speed: 2.0 GHz

Built-in memory: 8,192.0 MB

Real memory available to Lightroom: 8,192.0 MB

Real memory used by Lightroom: 895.5 MB (10.9%)

Virtual memory used by Lightroom: 4,899.6 MB

Memory cache size: 1,440.6MB

Maximum thread count used by Camera Raw: 5

Camera Raw SIMD optimization: SSE2,AVX,AVX2

Camera Raw virtual memory: 860MB / 4095MB (20%)

Camera Raw real memory: 870MB / 8192MB (10%)

Displays: 1) 5120x2880, 2) 2880x1800, 3) 1920x1080

Graphics Processor Info:

Metal: Intel Iris Pro Graphics

Application folder: /Applications/Adobe Lightroom Classic CC

Library Path: /Users/adam/Pictures/Lightroom/Lightroom Catalog.lrcat

Settings Folder: /Users/adam/Library/Application Support/Adobe/Lightroom

Installed Plugins:

1) AdobeStock

2) Aperture/iPhoto Importer Plug-in

3) Canon Tether Plugin

4) Facebook

5) Flickr

6) Nikon Tether Plugin

Config.lua flags: None

AudioDeviceIOBlockSize: 512

AudioDeviceName: Built-in Output

AudioDeviceNumberOfChannels: 2

AudioDeviceSampleRate: 44100

Build: 10.0x7

CoreImage: true

GL_ACCUM_ALPHA_BITS: 0

GL_ACCUM_BLUE_BITS: 0

GL_ACCUM_GREEN_BITS: 0

GL_ACCUM_RED_BITS: 0

GL_ALPHA_BITS: 8

GL_BLUE_BITS: 8

GL_DEPTH_BITS: 24

GL_GREEN_BITS: 8

GL_MAX_3D_TEXTURE_SIZE: 2048

GL_MAX_TEXTURE_SIZE: 16384

GL_MAX_TEXTURE_UNITS: 8

GL_MAX_VIEWPORT_DIMS: 16384,16384

GL_RED_BITS: 8

GL_RENDERER: Intel Iris Pro OpenGL Engine

GL_SHADING_LANGUAGE_VERSION: 1.20

GL_STENCIL_BITS: 8

GL_VENDOR: Intel Inc.

GL_VERSION: 2.1 INTEL-10.25.17

OGLEnabled: true

GL_EXTENSIONS: GL_ARB_color_buffer_float GL_ARB_depth_buffer_float GL_ARB_depth_clamp GL_ARB_depth_texture GL_ARB_draw_buffers GL_ARB_draw_elements_base_vertex GL_ARB_draw_instanced GL_ARB_fragment_program GL_ARB_fragment_program_shadow GL_ARB_fragment_shader GL_ARB_framebuffer_object GL_ARB_framebuffer_sRGB GL_ARB_half_float_pixel GL_ARB_half_float_vertex GL_ARB_instanced_arrays GL_ARB_multisample GL_ARB_multitexture GL_ARB_occlusion_query GL_ARB_pixel_buffer_object GL_ARB_point_parameters GL_ARB_point_sprite GL_ARB_provoking_vertex GL_ARB_seamless_cube_map GL_ARB_shader_objects GL_ARB_shader_texture_lod GL_ARB_shading_language_100 GL_ARB_shadow GL_ARB_sync GL_ARB_texture_border_clamp GL_ARB_texture_compression GL_ARB_texture_compression_rgtc GL_ARB_texture_cube_map GL_ARB_texture_env_add GL_ARB_texture_env_combine GL_ARB_texture_env_crossbar GL_ARB_texture_env_dot3 GL_ARB_texture_float GL_ARB_texture_mirrored_repeat GL_ARB_texture_non_power_of_two GL_ARB_texture_rectangle GL_ARB_texture_rg GL_ARB_transpose_matrix GL_ARB_vertex_array_bgra GL_ARB_vertex_blend GL_ARB_vertex_buffer_object GL_ARB_vertex_program GL_ARB_vertex_shader GL_ARB_window_pos GL_EXT_abgr GL_EXT_bgra GL_EXT_blend_color GL_EXT_blend_equation_separate GL_EXT_blend_func_separate GL_EXT_blend_minmax GL_EXT_blend_subtract GL_EXT_clip_volume_hint GL_EXT_debug_label GL_EXT_debug_marker GL_EXT_draw_buffers2 GL_EXT_draw_range_elements GL_EXT_fog_coord GL_EXT_framebuffer_blit GL_EXT_framebuffer_multisample GL_EXT_framebuffer_multisample_blit_scaled GL_EXT_framebuffer_object GL_EXT_framebuffer_sRGB GL_EXT_geometry_shader4 GL_EXT_gpu_program_parameters GL_EXT_gpu_shader4 GL_EXT_multi_draw_arrays GL_EXT_packed_depth_stencil GL_EXT_packed_float GL_EXT_provoking_vertex GL_EXT_rescale_normal GL_EXT_secondary_color GL_EXT_separate_specular_color GL_EXT_shadow_funcs GL_EXT_stencil_two_side GL_EXT_stencil_wrap GL_EXT_texture_array GL_EXT_texture_compression_dxt1 GL_EXT_texture_compression_s3tc GL_EXT_texture_env_add GL_EXT_texture_filter_anisotropic GL_EXT_texture_integer GL_EXT_texture_lod_bias GL_EXT_texture_rectangle GL_EXT_texture_shared_exponent GL_EXT_texture_sRGB GL_EXT_texture_sRGB_decode GL_EXT_timer_query GL_EXT_transform_feedback GL_EXT_vertex_array_bgra GL_APPLE_aux_depth_stencil GL_APPLE_client_storage GL_APPLE_element_array GL_APPLE_fence GL_APPLE_float_pixels GL_APPLE_flush_buffer_range GL_APPLE_flush_render GL_APPLE_object_purgeable GL_APPLE_packed_pixels GL_APPLE_pixel_buffer GL_APPLE_rgb_422 GL_APPLE_row_bytes GL_APPLE_specular_vector GL_APPLE_texture_range GL_APPLE_transform_hint GL_APPLE_vertex_array_object GL_APPLE_vertex_array_range GL_APPLE_vertex_point_size GL_APPLE_vertex_program_evaluators GL_APPLE_ycbcr_422 GL_ATI_separate_stencil GL_ATI_texture_env_combine3 GL_ATI_texture_float GL_ATI_texture_mirror_once GL_IBM_rasterpos_clip GL_NV_blend_square GL_NV_conditional_render GL_NV_depth_clamp GL_NV_fog_distance GL_NV_light_max_exponent GL_NV_texgen_reflection GL_NV_texture_barrier GL_SGIS_generate_mipmap GL_SGIS_texture_edge_clamp GL_SGIS_texture_lod

There has been many reports of problems with NAS drives and the network protocol used especially with Mac computers.

Copy some of those image, using the File Manager program for your OS, over to one of your internal drive or an external connected directly to your system and then view them with LR, Bridge and ACR. I bet you won't see that corruption. Or if you do then something other than LR is corrupting the files.

Views

1.5K

Likes

Translate

Translate

Report

Report
Community Guidelines
Be kind and respectful, give credit to the original source of content, and search for duplicates before posting. Learn more

Lightroom is corrupting the original jpeg files on a NAS. Backups can prove this.

New Here ,
Nov 21, 2017

Copy link to clipboard

Copied

Hi there,

I've just started using Lightroom classic on OSX, and began importing files (add, not copy) from a reliable NAS (with raid6) next to the mac. Something quite troubling is that a lot of my JPEG files are being corrupted by Lightroom, and every time I try to research this I keep finding people dismiss it entirely as "nah it can't be lightroom ever its a bad camera / card reader / hdd, etc" but this simply isn't true in this case. My proof? I can go through all the photos on the file share in osx preview and full images and zoom (not just thumbnail previews) will load fine. I go into lightroom to open the same image as a 1:1 and as the image starts loading chunk by chunk (as it would do on slow network storage) about 30% of those images will show about a quarter of the image and leave the rest blank like this https://i.imgur.com/uLbojxb.jpg . This sucks but the real killer is that it modifies the file on disk, corrupting my original jpeg! This can be confirmed by running stat on the file on the NAS just seconds after loading the image:

adam@edge:/mnt/nas-lv/camera/DCIM/106_PANA$ stat P1060671.JPG

  File: ‘P1060671.JPG’

  Size: 6693376       Blocks: 13088      IO Block: 4096   regular file

Device: fd06h/64774d    Inode: 221320927   Links: 1

Access: (0777/-rwxrwxrwx)  Uid: ( 1000/    adam)   Gid: ( 1000/    adam)

Access: 2017-11-20 21:21:05.800605669 +0800

Modify: 2017-05-18 11:14:58.000000000 +0800

Change: 2017-11-21 15:10:27.379631049 +0800

Birth: -

As you can see, this photo from May, which I had copied over to the NAS that same day, which I imported last night, and went to open the image in lightroom today, it had been modified at the exact moment I double clicked it in Lightrooms catalog. No other programs are accessing the files, and osx-preview had been quit beforehand. Lightroom is corrupting files, not a dodgy camera, not a single hard drive dying

I really want to move to using Lightroom but this is absolutely terrible, it keeps eating my photos. I've had to restore a whole backup of my originals folder from a secondary backup NAS because there's too many photos it has done this to. I would greatly appreciate any advice on this. I've attached a system info below. Thank you,

Adam

System info

Lightroom Classic version: 7.0.1 [ 1142117 ]

License: Creative Cloud

Operating system: Mac OS 10

Version: 10.12 [6]

Application architecture: x64

Logical processor count: 8

Processor speed: 2.0 GHz

Built-in memory: 8,192.0 MB

Real memory available to Lightroom: 8,192.0 MB

Real memory used by Lightroom: 895.5 MB (10.9%)

Virtual memory used by Lightroom: 4,899.6 MB

Memory cache size: 1,440.6MB

Maximum thread count used by Camera Raw: 5

Camera Raw SIMD optimization: SSE2,AVX,AVX2

Camera Raw virtual memory: 860MB / 4095MB (20%)

Camera Raw real memory: 870MB / 8192MB (10%)

Displays: 1) 5120x2880, 2) 2880x1800, 3) 1920x1080

Graphics Processor Info:

Metal: Intel Iris Pro Graphics

Application folder: /Applications/Adobe Lightroom Classic CC

Library Path: /Users/adam/Pictures/Lightroom/Lightroom Catalog.lrcat

Settings Folder: /Users/adam/Library/Application Support/Adobe/Lightroom

Installed Plugins:

1) AdobeStock

2) Aperture/iPhoto Importer Plug-in

3) Canon Tether Plugin

4) Facebook

5) Flickr

6) Nikon Tether Plugin

Config.lua flags: None

AudioDeviceIOBlockSize: 512

AudioDeviceName: Built-in Output

AudioDeviceNumberOfChannels: 2

AudioDeviceSampleRate: 44100

Build: 10.0x7

CoreImage: true

GL_ACCUM_ALPHA_BITS: 0

GL_ACCUM_BLUE_BITS: 0

GL_ACCUM_GREEN_BITS: 0

GL_ACCUM_RED_BITS: 0

GL_ALPHA_BITS: 8

GL_BLUE_BITS: 8

GL_DEPTH_BITS: 24

GL_GREEN_BITS: 8

GL_MAX_3D_TEXTURE_SIZE: 2048

GL_MAX_TEXTURE_SIZE: 16384

GL_MAX_TEXTURE_UNITS: 8

GL_MAX_VIEWPORT_DIMS: 16384,16384

GL_RED_BITS: 8

GL_RENDERER: Intel Iris Pro OpenGL Engine

GL_SHADING_LANGUAGE_VERSION: 1.20

GL_STENCIL_BITS: 8

GL_VENDOR: Intel Inc.

GL_VERSION: 2.1 INTEL-10.25.17

OGLEnabled: true

GL_EXTENSIONS: GL_ARB_color_buffer_float GL_ARB_depth_buffer_float GL_ARB_depth_clamp GL_ARB_depth_texture GL_ARB_draw_buffers GL_ARB_draw_elements_base_vertex GL_ARB_draw_instanced GL_ARB_fragment_program GL_ARB_fragment_program_shadow GL_ARB_fragment_shader GL_ARB_framebuffer_object GL_ARB_framebuffer_sRGB GL_ARB_half_float_pixel GL_ARB_half_float_vertex GL_ARB_instanced_arrays GL_ARB_multisample GL_ARB_multitexture GL_ARB_occlusion_query GL_ARB_pixel_buffer_object GL_ARB_point_parameters GL_ARB_point_sprite GL_ARB_provoking_vertex GL_ARB_seamless_cube_map GL_ARB_shader_objects GL_ARB_shader_texture_lod GL_ARB_shading_language_100 GL_ARB_shadow GL_ARB_sync GL_ARB_texture_border_clamp GL_ARB_texture_compression GL_ARB_texture_compression_rgtc GL_ARB_texture_cube_map GL_ARB_texture_env_add GL_ARB_texture_env_combine GL_ARB_texture_env_crossbar GL_ARB_texture_env_dot3 GL_ARB_texture_float GL_ARB_texture_mirrored_repeat GL_ARB_texture_non_power_of_two GL_ARB_texture_rectangle GL_ARB_texture_rg GL_ARB_transpose_matrix GL_ARB_vertex_array_bgra GL_ARB_vertex_blend GL_ARB_vertex_buffer_object GL_ARB_vertex_program GL_ARB_vertex_shader GL_ARB_window_pos GL_EXT_abgr GL_EXT_bgra GL_EXT_blend_color GL_EXT_blend_equation_separate GL_EXT_blend_func_separate GL_EXT_blend_minmax GL_EXT_blend_subtract GL_EXT_clip_volume_hint GL_EXT_debug_label GL_EXT_debug_marker GL_EXT_draw_buffers2 GL_EXT_draw_range_elements GL_EXT_fog_coord GL_EXT_framebuffer_blit GL_EXT_framebuffer_multisample GL_EXT_framebuffer_multisample_blit_scaled GL_EXT_framebuffer_object GL_EXT_framebuffer_sRGB GL_EXT_geometry_shader4 GL_EXT_gpu_program_parameters GL_EXT_gpu_shader4 GL_EXT_multi_draw_arrays GL_EXT_packed_depth_stencil GL_EXT_packed_float GL_EXT_provoking_vertex GL_EXT_rescale_normal GL_EXT_secondary_color GL_EXT_separate_specular_color GL_EXT_shadow_funcs GL_EXT_stencil_two_side GL_EXT_stencil_wrap GL_EXT_texture_array GL_EXT_texture_compression_dxt1 GL_EXT_texture_compression_s3tc GL_EXT_texture_env_add GL_EXT_texture_filter_anisotropic GL_EXT_texture_integer GL_EXT_texture_lod_bias GL_EXT_texture_rectangle GL_EXT_texture_shared_exponent GL_EXT_texture_sRGB GL_EXT_texture_sRGB_decode GL_EXT_timer_query GL_EXT_transform_feedback GL_EXT_vertex_array_bgra GL_APPLE_aux_depth_stencil GL_APPLE_client_storage GL_APPLE_element_array GL_APPLE_fence GL_APPLE_float_pixels GL_APPLE_flush_buffer_range GL_APPLE_flush_render GL_APPLE_object_purgeable GL_APPLE_packed_pixels GL_APPLE_pixel_buffer GL_APPLE_rgb_422 GL_APPLE_row_bytes GL_APPLE_specular_vector GL_APPLE_texture_range GL_APPLE_transform_hint GL_APPLE_vertex_array_object GL_APPLE_vertex_array_range GL_APPLE_vertex_point_size GL_APPLE_vertex_program_evaluators GL_APPLE_ycbcr_422 GL_ATI_separate_stencil GL_ATI_texture_env_combine3 GL_ATI_texture_float GL_ATI_texture_mirror_once GL_IBM_rasterpos_clip GL_NV_blend_square GL_NV_conditional_render GL_NV_depth_clamp GL_NV_fog_distance GL_NV_light_max_exponent GL_NV_texgen_reflection GL_NV_texture_barrier GL_SGIS_generate_mipmap GL_SGIS_texture_edge_clamp GL_SGIS_texture_lod

There has been many reports of problems with NAS drives and the network protocol used especially with Mac computers.

Copy some of those image, using the File Manager program for your OS, over to one of your internal drive or an external connected directly to your system and then view them with LR, Bridge and ACR. I bet you won't see that corruption. Or if you do then something other than LR is corrupting the files.

Views

1.5K

Likes

Translate

Translate

Report

Report
Community Guidelines
Be kind and respectful, give credit to the original source of content, and search for duplicates before posting. Learn more
Nov 21, 2017 0
Advocate ,
Nov 21, 2017

Copy link to clipboard

Copied

Have you got 'Include Develop settings in jpg etc' and 'Write settings to xmp' checked in Catalog settings under Prefs? If so, LR will write to jpgs.

Bob Frost

Likes

Translate

Translate

Report

Report
Community Guidelines
Be kind and respectful, give credit to the original source of content, and search for duplicates before posting. Learn more
Reply
Loading...
Nov 21, 2017 0
LEGEND ,
Nov 21, 2017

Copy link to clipboard

Copied

Check the File Sharing, Network protocol, setting on the NAS and OS X and if it is set to AFP change it to use SMB.

Likes

Translate

Translate

Report

Report
Community Guidelines
Be kind and respectful, give credit to the original source of content, and search for duplicates before posting. Learn more
Reply
Loading...
Nov 21, 2017 0
New Here ,
Dec 22, 2017

Copy link to clipboard

Copied

I'm having a very similar issue except Lightroom is corrupting my Sony ARW files added from my NAS Drobo 5n. It took me awhile looking through the internet researching bad cables and trying to find the failure point but then I caught it in the wild.

I was adding old photos into the Lightroom catalog and going through them and I noticed a surprising amount of them had black lines/other corruptions in them.

While using Adobe Bridge CC I started looking into folders I haven't added to Lightroom yet, all of my raws look fine in preview and at 100%. I started exporting batches of them and they all looked 100% normal.

I open those same photos in Lightroom CC Classic 7.1 and ~10% of my photos have black lines in them. I go back to bridge and sure enough those corruptions show up there and now exporting that same raw file leads to corrupted Jpegs.

Viewing and exporting photos in Bridge

Kingston Trip Kingston Trip _DSC0914.JPG

That same file after Adobe Lightroom previews it.

Kingston Trip _DSC0914_1.JPG

I'm glad I finally found the issue. This has blown up 100's of my photos before I realized it was Lightroom and not a bad copy creating this issues. Any tips?

Thanks!

Likes

Translate

Translate

Report

Report
Community Guidelines
Be kind and respectful, give credit to the original source of content, and search for duplicates before posting. Learn more
Reply
Loading...
Dec 22, 2017 0
LEGEND ,
Dec 22, 2017

Copy link to clipboard

Copied

LR never touches the original file.

LR builds previews of the images and that is what is displayed in LR.

While making edits to an image in LR the original files is never touched. All the edits are stored in the catalog file.

What you are seeing is either drive corruption and or image data corruption or a network sharing incompatibility.

The only thing that LR will write to a drive/folder that has images on/in it is to create an XMP sidecar file if you have the option in the Catalog setting window to Auto write change to XMP. But it still doesn't touch the image file itself.

What other program might be showing you is the JPG preview data that is always included in every RAW file. Which may not be corrupted.

Likes

Translate

Translate

Report

Report
Community Guidelines
Be kind and respectful, give credit to the original source of content, and search for duplicates before posting. Learn more
Reply
Loading...
Dec 22, 2017 0
New Here ,
Dec 22, 2017

Copy link to clipboard

Copied

Thanks for the reply. Interesting. I got both of these export photos by exporting the Raw directly out of Bridge using Camera Raw.

Are you saying the first time it exported from Bridge it exported the Jpeg preview of the photo but then after LR read the corruption it exported that image instead? That's the one thing that is throwing me off is why the raw preview in Camera Raw in bridge would vary from LR.

Likes

Translate

Translate

Report

Report
Community Guidelines
Be kind and respectful, give credit to the original source of content, and search for duplicates before posting. Learn more
Reply
Loading...
Dec 22, 2017 0
LEGEND ,
Dec 22, 2017

Copy link to clipboard

Copied

There has been many reports of problems with NAS drives and the network protocol used especially with Mac computers.

Copy some of those image, using the File Manager program for your OS, over to one of your internal drive or an external connected directly to your system and then view them with LR, Bridge and ACR. I bet you won't see that corruption. Or if you do then something other than LR is corrupting the files.

Likes

Translate

Translate

Report

Report
Community Guidelines
Be kind and respectful, give credit to the original source of content, and search for duplicates before posting. Learn more
Reply
Loading...
Dec 22, 2017 0
New Here ,
Dec 22, 2017

Copy link to clipboard

Copied

Oh man, thank you so much. Copying over to a local drives shows there are no corruptions in the raw files. I was so worried about Drive issues and potentially lost photos. You got it right, I'm a Mac user with a NAS Drobo 5n. Any suggestions for getting my NAS to play well with LR/my mac?

Thanks again.

Likes

Translate

Translate

Report

Report
Community Guidelines
Be kind and respectful, give credit to the original source of content, and search for duplicates before posting. Learn more
Reply
Loading...
Dec 22, 2017 0
LEGEND ,
Dec 22, 2017

Copy link to clipboard

Copied

Yeah make sure both the Mac and the NAS is using SMB as the network protocol and not the Apple version of networking (AFP I think it is called).

Check all the settings on the NAS for networking and also that it doesn't go to sleep to often or at all.

Likes

Translate

Translate

Report

Report
Community Guidelines
Be kind and respectful, give credit to the original source of content, and search for duplicates before posting. Learn more
Reply
Loading...
Dec 22, 2017 3
New Here ,
Apr 13, 2018

Copy link to clipboard

Copied

THANK YOU SO MUCH! I was freaking out as LR was destroying my photos, one by one. This saved me.

Likes

Translate

Translate

Report

Report
Community Guidelines
Be kind and respectful, give credit to the original source of content, and search for duplicates before posting. Learn more
Reply
Loading...
Apr 13, 2018 1