🗺️ QA & Testing · Journey Playbooks

Playbook: Clean up a flaky test swamp

CI trusted again: quarantine live, root causes classed, red means broken.

journey~65 minQA EngineersSDETsTest Automation Engineers

Journey Steps

1Step 1 — Eliminate flaky tests systematically: start with "Auto-detect flakiness via retry-pass detection; report rate weekly"
2Step 2 — Prioritize testing by risk, not habit: start with "List modules; score failure probability from change frequency + complexity"
3How it fits together: Quarantine restores trust immediately; root-causing keeps it.

Commands

Install all referenced skills

$ npx skills add aniruddhaadak80/skills --skill automation-flaky-test-elimination && npx skills add aniruddhaadak80/skills --skill test-strategy-risk-based-testing

Tags

#playbook#journey#qa-testing

Install this skill

$ npx skills add aniruddhaadak80/skills --skill playbook-qa-testing-flake-cleanup -a opencode

SKILL.md

# Playbook: Clean up a flaky test swamp

> CI trusted again: quarantine live, root causes classed, red means broken.

## When to Use This Skill

CI trusted again: quarantine live, root causes classed, red means broken.

## Steps

1. Step 1 — Eliminate flaky tests systematically: start with "Auto-detect flakiness via retry-pass detection; report rate weekly"
2. Step 2 — Prioritize testing by risk, not habit: start with "List modules; score failure probability from change frequency + complexity"
3. How it fits together: Quarantine restores trust immediately; root-causing keeps it.

View source on GitHub ↗

Take retrieval-augmented answers from empty repo to evaluated production feature.

🗺️ AI Engineering·~135m

Open →

🗺️Playbook: Harden an agent before giving it toolsjourney

Ship an autonomous agent whose failure modes are cheap, visible, and reversible.

🗺️ AI Engineering·~125m

Open →

🗺️Playbook: Cut LLM costs without quality collapsejourney

Reduce monthly inference spend measurably while keeping answer quality within tolerance.

🗺️ AI Engineering·~95m

Open →