Stabilizer settings for smooth panning

I am trying to use the warp stabilizer to get smooth panning of some footage. The issue is that the result is very strange. I just can see some part of the clip down in the corner of the preview window.

Any ideas how to achieve what I want - which is some smooth panning?

Image 1 - This is the video with no FX:

Image 2 - this is the FX settings on the video clip:

Image 3 - this is the video after the FX is applied. Seems like half of it is missing av a lot of black on top here? 

Image 4 - one of the last frames are then showing completely again: