What to Track and How to Track It