Layer Jumping out of Artboard

I have a group of layers that represent a panel. I have duplicated this group and moved it so that only part of this group is visible within the artboard. This means that some layers in the group are out of the artboard's bounds.

I noticed that if I change one of these layers' style or move it, the whole layer jumps outside of the artboard. It's rather frustrating, and it ruins the hierarchy of my layers. If I try to put it back into the folder, Photoshop repositions that layer to the center, which is also not the desired effect.

Is there a way to turn this off? Is this a bug? Thanks for the help!