I think it is important to have key metrics to measure your success. This is the whole idea of the lean startup movement. Build, measure, learn.

The most important thing IMO is to pick the key metrics.