⚡AgentSkills
📊 Data Science & Analytics · Experimentation & A/B Testing

Write metric definitions as contracts

One canonical definition per metric, versioned and documented, killing dashboard wars.

intermediate~30 minData ScientistsAnalystsResearch Scientists

Steps

  1. 1Create a metric catalog entry per KPI: formula, grain, filters, owner
  2. 2Specify inclusion/exclusion rules explicitly (bots, refunds, internal staff)
  3. 3Implement once in the semantic layer; dashboards reference it
  4. 4Version definitions; changelog when business logic changes
  5. 5Backfill check: recompute last 12 months after any change
  6. 6Review catalog quarterly; archive dead metrics loudly

Common Pitfalls

  • ▲'Active users' meaning three things in three dashboards
  • ▲Revenue defined differently between finance and product

Commands

Install with skills CLI
$ npx skills add aniruddhaadak80/skills --skill experimentation-metric-definition-contracts
Install globally
$ npx skills add aniruddhaadak80/skills --skill experimentation-metric-definition-contracts -g

Tags

#metrics#governance#analytics-engineering#data-science#experimentation

Related skills

Design an A/B test you can trustintermediate

Power the test upfront, guard metrics, and commit to decision rules before peeking.

📊 Data Science & Analytics·~35m
Open →