Product Metrics Review
Interpret change only after validating the metric.
- State the product decision, metric contract, source, time period, owner, and freshness.
- Check denominator, cohort, time zone, missing data, tracking changes, releases, and definition changes before explaining movement.
- Segment the change by the few dimensions that can reveal meaningful differences; avoid fishing.
- Separate observation, hypothesis, evidence, and next test.
- Recommend an owner, decision date, and stop condition for follow-up.
Do not confuse correlation with causal proof or publish a metric interpretation without the caveats that materially change it.