I'm with Mylenium on this but I would add another step in your workflow. Here's what I would do:
Trim your clip so you are not processing any more frames than needed
Add levels to the layer and adjust the settings to increase the contrast and the usable pixels
Pre-compose moving all attributes
Track in Mocha AE - you will get a lot more accurate track using Mocha AE
When you have created your track you can export the mask or use it on the current layer and just open the pre-comp and turn off the levels.
Any time you are trying to track anything consider the image. About half of my tracking work involves color correction first to improve the chances of getting a good track. I also color correct and pre-compose all the time when I'm using Rotobrush. Almost every time I then open the pre-comp and turn off the color correction.
* The "Drag & Drop here..." area is buggy and should not be used to share images. Please use the toolbar or just drag your images to the reply field.
Yeah, jsut not enough contrast and eyeballs are not perfectly round, anyway. You should probably give mochaAE a whirl. Its shape trracking is much more reliable. Otherwise it may simply be more efficient to animate this by hand.