Problem: I can resize a masked group, resize the image in the masked group, but I can't resize both

Ever so often I get a really annoying problem.

Normally I like to make a group, put a mask on it, put ajustment layers and a smart object image inside with smart filters enabled all packaged nice and neat.

I click on the group, change it's scale; Joy! Everything inside scales.

HOWEVER! Sometimes there is no joy, only rage!

Sometimes when I click on the masked group and make ajustments to the scale, the only thing scaling in the mask on the group. The image no longer changes size to match the mask, I try selecting the group and the image inside directly, still still only scaling the mask. I select the image inside the group, it will scale image but the mask on the group doesn't do anything.

Once that happens, I have no choice, either bang my head on the keyboard and flip furniture like an enraged chimp or start anew.

Anyone know why it does that? Is it a feature?

If so, how do I turn the Enrage User toggle to off?

Thank you for your time.