Using a Pen Display Tablet with Character Animator in Record mode results in weird behavior

Hi I am trying to use the pen display tablet with Character Animator. Its a Huion 22 inch display.
It works well in the Rig mode. 
However if I use it in Record mode. and try to drag a draggable handle. its not responding the way a mouse does. ANyone facing similar issues?

This is what happened why I tried to drag the characters left wrist.
Any help would be appreciated, since I find tablet more easy to use than mouse.
Thank you