Dangle Physics Weirdness

Hi! 
I'm not sure there is a solution to this, but I'm willing to try anyway with the help of wiser people!

I'm experiencing some problems related to some dangle handles and the transform behaviour.

I need a character (for various shot changes) to be able to flip horizontally, without creating and riggin a whole new version of it, as the deadline imposes its shadow. 
So what I did is to create a X Scale keyframe, and set the keys from 100% to -100%, to do a perfect flip with no transitioning, as I made the keyframes next to the other.

So the problem is, if I have a single dangling handle (And I'm plenty) the animation will be ruined as the physic strikes in and it looks like the character exploded for a moment to then settle to position.
It is an absolutely logical issue, but I'm wondering if there are any workarounds.

(A thing I tried is to keyframe the physics as well, in order to disable that behaviour at the right moment, but that did not seem to work, annd here it becomes less logical)

I hope to find hope, and wish you a great day!