Adjustment layer seems to be affecting artwork above?

Hi all,

Am new to After Effects but have tried the below tutorial to create a wiggle effect for my artwork.

https://www.youtube.com/watch?v=b0JesMPdeIk&t=2s

At first the adjustment layer was at the top of all other layers but I have decided it looks strange applied to the carrots so have rearranged so that it is sitting above the text layer only. The problem is now that my carrot illustrations still have the wiggle effect applied and I am not sure why. They don't animate anymore but still are wobbly from effect?