Which tracker are you using? The point tracker, the mask tracker, the face tracker, Mocha AE, the camera tracker, or a third party plugin like Lockdown, King Pin Tracker, or Spot Clone Tracker? There are some tips, but they vary based on the tracker you're using.
You may have to manually track it after a certain point, but doing it every x frames instead of every frame is probably a better plan.
... View more