Render time from 1s to 42s if parallel light is on.

Having a parallel light casting shadows turns a 1s render to a 42s render (one frame).
What the hell?

Those labels are the only things casting shadows (and not accepting light) onto a 'shadow catcher' layer.