Camera switching and performance on iPad

I have built an app that uses both cameras to stream video with the ability to let the user switch between them.  It seems to work fine, however, there is a noticable difference in performance.  The front (facetime) camera is nice and smooth, but the back camera is very choppy.  I am guessing that this has something to do with the fact that the front camera is only .3MP and the rear is 5.0MP.

Has anyone else noticed this?  Any way to speed up the framerate?  Video capturing seems to be the same for both cameras in native apps.