The camera tracker is a little long in the tooth, and there are three big improvements I would suggest:
1) the ability to use an alpha/mask so it doesn't consider parts of the image when tracking (perhaps this exists, I've just yet to find out how to do it);
2) the ability to, after a track, automatically reject/delete points based on their error (i.e. all points above a tracking error of 1 (or whatever is chosen) are deleted across the entire track;
3) A button so that the camera only re-solves on command rather than every time tracking points are deleted, so points can be deleted across the entire track without having to wait for the solve every time.