That's part of what we're trying to quantify with the mRhythm Study--both the accuracy of heart rate sensors on average, but more importantly, how to predict in which situations and for which people the sensor is likely to work accurately enough for clinical use.
One tip I've found: if you wear the watch slightly higher up your forearm, it often gets a better reading than if you wear it directly on your wrist.