pan behind tool affects position too, when i keyframe my anchor point, the position moves with it making messing up the placement

Hi ​@Callum34464596sr7a ,

This is expected behavior. If you want your Anchor Point to move and have your layer remain in the same place, the Position needs to be updated. If you only want to adjust your Anchor Point, you can hold Alt/Opt while dragging the Anchor Point, but your layer will then move since its coordinates aren’t being updated at the same time. This is the same as scrubbing the Anchor Point parameter in the Timeline or Properties panel.

These moves are necessary because an Anchor Point’s coordinates are relative to its layer and the layer’s coordinates are relative to the Comp. 

-David, After Effects Engineering Team