Dangle object distorted after position keyframe

I have a character with earrings that have dangle applied to them. The dangle works great during recording. I have various “scenes” on the timeline where the character changes position on screen using hold keyframes. For example, one scene he will be on the right of screen, and the next scene he’s center screen.

On every one of these scene changes, the earrings show a huge distortion for about a second until the dangle settles into the new position (see screenshots).

I know this is likely happening because of the sudden change in position of the hold keyframes. Is there any way to avoid this distortion or a different approach I should use to implement these scene changes?