Slicing puppet into clips and movements?

Hi, I'm using my character as a narrator in a news story, and I will add video B-roll in the background (I do this via the dynamic link to After Effects, and add the video there). As my b-roll switches I want to be able to switch the position of my character. Therefore I have sliced my puppet into shorter sections in Character Animator, and set different x,y positions and scale for the different sections, synced with the B-Roll switch.

I would also like the arms (for example) held in a specific position the beginning of each new section. For that I put the arms in the position I want them to be, press record and quickly stop the recording. Then, drag this "Dragger" element in the timeline to be as long as the section. 

But the problem is that in the first few frames, for some reason the character "moves" into place before taking and holding the position of the arms I want to have as the starter position. See video attached and you will know what I mean, the wrists are moving into position in the first few frames. And I'm also attaching a screenshot of the timeline I have in Character Animator for reference. Note: if I go frame by frame in the Character Animator preview, I do not see the wrist issue.

Basically, my goal is to be able to press record at the beginning of each of the sections I have sliced, and have the character in a specific position, scale, and with the placement of limbs as I want them to be so that I can hit record and make movements starting from there.

How could I achieve that please? I'm missing something, what am I doing wrong? Maybe there's a better approach.

Thanks!