Ab Test Analyzer

Designs and analyzes A/B tests end-to-end — frames a sharp hypothesis, computes required sample size and test duration, runs significance tests (two-proportion z-test, Welch's t-test, chi-square), reports confidence intervals and lift, and flags common pitfalls like peeking, multiple comparisons, and Simpson's paradox. Use this skill when the user mentions A/B testing, split testing, experiment design, conversion-rate experiments, statistical significance, p-values, sample size or power calculations, "did this experiment win", minimum detectable effect (MDE), or asks to interpret experiment results honestly. Includes a runnable stats script (scripts/abtest.py).

JayRHa Updated 12 repo stars
Jannik Reinhard — I help enterprises ship secure AI agents

File contents

JayRHa/AgentSkills commit 4eeb6264ce

Frequently asked questions

npx get-skill add jayrha/ab-test-analyzer