Use pen for drawing and fingers to pan/zoom

Hi,

I am using the pen of my surface pro 4 to draw shapes with the pencil/paintbrush tools. I would like to zoom/pan using my fingers, but when I try to do this it draws instead. So now I have to toggle between the selection tool and the pencil tool all the time. Is there a way that illustrator can be set so that it only draws when I use the pen tool, and pans/zooms when using 2 fingers?