ab-test-significance
ab-test-significance
Use when the user wants to check whether an A/B test result is statistically significant, or to size a test before running it. Also use when the user mentions A/B test, split test, statistical significance, p-value, confidence level, conversion lift, sample size, or "is this result real / can we call the test." Produces lift, p-value, a significance verdict, and required sample size.
updated 6/18/2026
// install
bash
$
npx skills add sarojkjha/aaj-marketing-skills --skill ab-test-significance// what you give
Visitors and conversions for control and variant (to evaluate) OR baseline rate and minimum detectable effect (to size a test)
// what you get
Conversion rates, relative lift, p-value, significance verdict, confidence interval, and required sample size
// agents
Claude Code
Cursor
OpenAI Codex
Windsurf
Cline
Go deeper (AAJ)
// run it
agent · engine
$
// faq