Pick Whip layers affected by Adjustment Layer

Often times I need to add an adjustment layer to another layer but there are other layers below it that I don't want affected. The "option" to pick whip (or another method - list?) which layers are and are not affected would solve this. Anyone else see the value in this?