Skip to main content
Inspiring
May 22, 2011
Released

P: Better Develop Module Performance

  • May 22, 2011
  • 45 replies
  • 1031 views

On my machine (DELL E6400) adjusting the exposure of an image in the Develop module is more difficult than it should be because of the time lag between moving the slider and the image update.

I suggest a different strategy for generating visual feedback that yields better immediate performance, possibly trading in slight inaccuracies at first, but within a scheme that resolves the latter as soon as possible. Please see the end of this FR for the actual suggestion; I'd like to motivate it first.

It appears that the fixed order in which image operations are applied in the LR pipeline causes some adjustments to result in worse interactivity than necessary. Adjusting the exposure with no other (not even default) image adjustment settings is quick.

With some other image adjustments in place, however -- in particular when using the "Details" panel -- adjusting exposure results in jerky image updates that make it hard to find the correct level accurately and quickly.

I'm assuming that the LR image pipeline mandates that exposure updates happen relatively early, so that sharpening etc. always has to be recomputed after an exposure update. This is why updating the exposure is quick when no other adjustments have to be performed but slow otherwise.

Just to make sure that I'm making the correct assumptions, here's how I arrived at my conclusions:

My initial issue was that updates to the image in the Develop modules seemed to be slow and jerky in full screen mode whereas they were quick and led to smooth updates when I used LR in window mode. It turned out that the deciding factor is the size of the image. Images in portrait orientation are naturally displayed smaller and are less affected by the performance problems. Even images in landscape orientation can show smooth updates in full screen mode, if one artificially decreases their size by making the left hand side panels as wide as possible.

So it seems to me that:
a) LR struggles to deliver a decent image update frequency in the Develop module when the image is above a certain size (at least on my hardware).
b) This performance issue is a problem not only for computation intensive operations, like lens correction, but for simple ones like "exposure" because apparently potentially computation intensive operations, e.g., sharpening/noise reduction, come after exposure in the pipeline and have to be redone after each exposure update.
c) This is a big problem since I'd like to be able to apply some default sharpening on import (or even lens correction for some lenses) and not delay such settings after I have done other image adjustments in the Develop module.

It is clear to me that the user should not be forced to perform edits in a certain order (in addition to the aforementioned problems there is also a common advice to put off spot removals or lens corrections till the end) in order to address LR performance issues.

Here's the actual suggestion:

Could LR not cache all previous adjustments and apply the current image adjustment (e.g., exposure) as the last update in a relative manner?

I realise that this goes against the fixed ordering of the pipeline, but the latter is the problem causing the performance issues. When image operations are commutative they should be applied in the order which provides the best performance (with the use of caching, of course).

I also realise that some image operations (e.g., sharpening and exposure) only seem commutative but may not be completely commutative. It may matter (slightly) whether sharpening or exposure adjustments is performed first. Nevertheless, for the initial visual feedback, it should suffice in most cases to perform the current adjustment as the last and thus be able to capitalise on prior image caching.

Once the user stopped doing the adjustment, i.e., once there is no need to provide immediate visual feedback anymore, LR could recompute the current image using the standard image pipeline ordering. This may in some cases cause a subsequent, subtle change to the image after a short while, but I strongly believe I would prefer that if it meant that my current adjustments would just be a small delta to previous adjustments causing smooth updates rather than causing (almost?) the whole pipeline to be re-triggered.

Note that the proposed scheme would address the concerns regarding inaccurate image renderings in the Develop module. Noise reduction could always be performed, at all magnification levels, if it only impeded the speed of the final rendering -- after direct interactivity is no longer needed -- but would not impact on the interactivity of image adjustments that become before noise reduction in the image pipeline.

The proposed approach may even mean that using the adjustment brush on images with a high number of edits (including a multitude of previous brush strokes) may become more interactive. Currently, the lag between moving the mouse cursor and seeing the effect of the brush, becomes larger the more edits an image has. This may just point to caching potential regarding brushes (I hope not all strokes are always redrawn), but may also be related to the pipeline issue.

45 replies

Sean H [Seattle branch]
Known Participant
October 15, 2012
Dan, thanks for clearing that up. I really do appreciate the time you are taking to clue us in.

For those of us that prioritize performance over precision [a huge group I'd imagine], I would love the 1:1 previews to be initially in a color space appropriate for the Develop module. Why not? It's simple matrix math, eh?

TK is spot on, too. The reason I desire the quick preview and slider access is for those images that I don't even want to adjust. I've already applied the adjustments upon ingestion (sharpening/contrast/fill/highlight) and the 1:1 previews are either good or very close.

For one job, I prune down to 1000 images in the Library module. When I step into the Develop module, that's 1500-2000 seconds of pure render delay. That's 30 minutes per job times 30 jobs = 900 minutes per year [15 hours] (on the low end) I'm taping my finger while LR is rendering before I can determine I I simply want to move to the next photo. Let me state that again: that's 15 hours regardless if I want to make an adjustment or just move to the next photo. And, that's with my 6-core 3.33GHz machine. Most of my peers are using much slower machines.

So, pulling from the 1:1 versus the re-render would be one potent kicking of the can in my case.
[ ◉"]
Inspiring
October 15, 2012
Dan, you write "...so using a fast preview would just kick the can a bit further down the road, so to speak. It was viewed as better to delay enabling the controls".

The advantage of kicking the can further down the road would be that one could stay in the Develop module when navigating between images.

Partly due to preview caches not being handled properly, navigating in the Develop module can be painful to the extent that I sometimes switch to the library module to locate an image (or force an update to the Develop module previews) and then switch back again.

AFAIC, it should never be necessary to leave the Develop module just because one wants to quickly flick through some images, to compare them or chose the next one for editing.
Participating Frequently
October 15, 2012
Almost lost the other question in all the noise (though I will note there aren't many folks in Seattle in a position to affect Lightroom Develop module performance regardless of bribery or threats ;o).

Anyway, getting back to the question for me before this thread ran off: "What's the difference between the ACR cache version of the raw file that I made in the Library module and the render version that gets made when I choose the raw file in the Develop module?" The difference is that the Library module is loading a fully rendered JPEG of the raw with settings applied. The ACR Cache doesn't store fully rendered previews so it still has to do the actual rendering work.

The cache does allow ACR to skip some expensive work toward the beginning of its pipeline, but the rest is done when the image is opened. Note also that previews are rendered into a color space that may not produce precisely the same results as you'll see on screen in Develop (which works in a wider gamut space, IIRC), so those previews aren't suitable for use in Develop. Lastly, the moment you actually started to move a control, ACR would have to do the setup and rendering anyway, so using a fast preview would just kick the can a bit further down the road, so to speak. It was viewed as better to delay enabling the controls and be responsive when they were used than to enable immediately and have them be initially sluggish.

That's not to say it couldn't be made faster, only that there are reasons for why it works as it does at the moment, so it's probably not simple or trivial to make it faster to load. Hopefully that's illuminating or at least helpful.
areohbee
Legend
October 11, 2012
Those must be some killer donuts ;-}.

I'd still like to talk with you about your experience using EditInLightroom. Even if you've given up already, it may help to improve it so others can use it successfully.

http://forums.adobe.com/people/areohbee

Cheers,
Rob
Sean H [Seattle branch]
Known Participant
October 11, 2012
It's Seattle, I'd bring coffee and Top Pot Donuts for the whole office.
[ ◉"]
areohbee
Legend
October 11, 2012
I doubt they will be more likely to accelerate development in response to the personal nature of your visit - could be wrong. Got a plan B?
Sean H [Seattle branch]
Known Participant
October 11, 2012
Well, how about the strategy of me driving down the street and knocking on their door? I live about 2 miles away from their office....
[ ◉"]
areohbee
Legend
October 11, 2012
You're preaching to the choir (although I have a voracious appetite for some cool trick tools too). And, Adobe has heard you too, even if they don't respond. But it's going to be at least a year or so, at the earliest, and maybe longer, so it may be worth considering a strategy for the mean time. PS - I'm now guessing you were using EditInLightroom with proprietary raws (right?), - try with DNGs - it's smoother. PPS - Don't forget to check that "Don't show again" box when you've seen a prompt as much as you care to ;-}.
Sean H [Seattle branch]
Known Participant
October 11, 2012
I'm not certain about that timeframe.... At it's present incarnation, I could use Lightroom for 20 years. CPUs will become more powerful and the image files will become more detailed, but the functionality is pretty much there barring some cool trick tools. So, this is a perfect time to focus purely on optimizations and rethink and improve the engine.
[ ◉"]
areohbee
Legend
October 10, 2012
Sean,

I couldn't agree more - improvement should be built-in. But, seeing as we've now gone over half a decade without such improvement, it seems worthwhile to consider workarounds for the mean time. It might be another half decade before Lr has such improvement... Anyway, many plugins that push the envelope require some reading of "the fine print" too. But if your originals were DNG, then 'Update DNG Previews & Metadata" should trigger Lightroom to re-apply the lo-rez settings to the hi-rez version (along with flags...), after invoking the 'Edit Hi-Rez' plugin command.

Anyway, feel free to contact me outside the forum for plugin support.

Rob