🗺️ Data Science & Analytics · Journey Playbooks

Playbook: Run your first trustworthy A/B test

A correctly powered experiment with pre-committed decision rules.

journey~70 minData ScientistsAnalystsResearch Scientists

Journey Steps

1Step 1 — Design an A/B test you can trust: start with "Define one primary metric with minimum detectable effect from business value"
2Step 2 — Build cohort and funnel analyses that hold up: start with "Define cohorts by first meaningful action, not signup alone"
3How it fits together: Sample size math BEFORE launch. Peeking destroys more experiments than bugs do.

Commands

Install all referenced skills

$ npx skills add aniruddhaadak80/skills --skill experimentation-ab-test-design && npx skills add aniruddhaadak80/skills --skill exploratory-analysis-cohort-funnel-analysis

Tags

#playbook#journey#data-science

Install this skill

$ npx skills add aniruddhaadak80/skills --skill playbook-data-science-first-ab-test -a opencode

SKILL.md

# Playbook: Run your first trustworthy A/B test

> A correctly powered experiment with pre-committed decision rules.

## When to Use This Skill

A correctly powered experiment with pre-committed decision rules.

## Steps

1. Step 1 — Design an A/B test you can trust: start with "Define one primary metric with minimum detectable effect from business value"
2. Step 2 — Build cohort and funnel analyses that hold up: start with "Define cohorts by first meaningful action, not signup alone"
3. How it fits together: Sample size math BEFORE launch. Peeking destroys more experiments than bugs do.

View source on GitHub ↗

Take retrieval-augmented answers from empty repo to evaluated production feature.

🗺️ AI Engineering·~135m

Open →

🗺️Playbook: Harden an agent before giving it toolsjourney

Ship an autonomous agent whose failure modes are cheap, visible, and reversible.

🗺️ AI Engineering·~125m

Open →

🗺️Playbook: Cut LLM costs without quality collapsejourney

Reduce monthly inference spend measurably while keeping answer quality within tolerance.

🗺️ AI Engineering·~95m

Open →