ab-test-setup

SKILL.md

A/B Test Setup

1️⃣ Purpose & Scope

Ensure every A/B test is valid, rigorous, and safe before a single line of code is written.

  • Prevents "peeking"
  • Enforces statistical power
  • Blocks invalid hypotheses

2️⃣ Pre-Requisites

You must have:

  • A clear user problem
  • Access to an analytics source
  • Roughly estimated traffic volume

🧠 Knowledge Modules (Fractal Skills)

1. Hypothesis Quality Checklist

2. 3️⃣ Hypothesis Lock (Hard Gate)

3. 4️⃣ Assumptions & Validity Check (Mandatory)

4. 5️⃣ Test Type Selection

5. 6️⃣ Metrics Definition

6. 7️⃣ Sample Size & Duration

7. 8️⃣ Execution Readiness Gate (Hard Stop)

8. During the Test

9. Analysis Discipline

10. Interpretation Outcomes

11. Test Record (Mandatory)

Weekly Installs
2
GitHub Stars
383
First Seen
Feb 21, 2026
Installed on
amp2
github-copilot2
codex2
kimi-cli2
gemini-cli2
cursor2