Clone stamp out of place/position

Hello, I am cloning part of a frame onto the next frame and tracking it to the end.  Just when I alt click on the position and pickwhip it to the tracking the clone jumps out of its original position and looks terrible.  What am I doing wrong to get this?  Why doesnt it stay in place?