// analytics-experimentation

Analytics & Experimentation

Unit economics, analytics, and A/B testing.

4 skills

Execute

ab-test-significance

engine

A/B Test Significance

Use when the user wants to check whether an A/B test result is statistically significant, or to size a test before running it. Also use when the user mentions A/B test, split test, statistical significance, p-value, confidence level, conversion lift, sample size, or "is this result real / can we call the test." Produces lift, p-value, a significance verdict, and required sample size.

Analytics & Experimentation·Starter#ab-testing#significance
$ npx skills add ab-test-significance

Diagnose

incrementality-and-mmm

engine

Incrementality And Mmm

Use when the user wants to know whether marketing spend actually caused conversions, rather than just preceded them — incrementality testing, holdout or geo tests, iROAS, or media mix modelling. Also use when the user mentions incrementality, holdout test, geo test, lift test, iROAS, incremental CAC, MMM, "is this channel actually working", or doubts about attributed conversions. Designs the test, sizes it, then reads it out honestly — including whether it was ever powerful enough to answer the question.

Analytics & Experimentation·Intermediate#incrementality#holdout-test
$ npx skills add incrementality-and-mmm

Execute

marketing-report

engine

Marketing Report

Use when the user wants to build a board-ready marketing report, a KPI dashboard, or a monthly/quarterly performance review — turning raw funnel, spend, and pipeline numbers into metrics and a narrative leadership can act on. Also use when the user mentions marketing reporting, KPI dashboard, board deck, marketing metrics, funnel conversion, CAC or ROI reporting, attribution narrative, or "what do I show the board / how is marketing performing." Produces a full-funnel KPI snapshot (stage conversion, CAC, efficiency, attainment) with period-over-period deltas and a decision-focused narrative.

Analytics & Experimentation·Intermediate#marketing-report#kpi-dashboard
$ npx skills add marketing-report

Diagnose

unit-economics

engine

Unit Economics

Use when the user wants to calculate or sanity-check unit economics — LTV, CAC, the LTV:CAC ratio, and CAC payback — for a subscription, ecommerce, or services business. Also use when the user mentions lifetime value, customer acquisition cost, payback period, churn, contribution margin, or "are our unit economics healthy / can we afford to spend more." Produces the metrics plus a verdict against healthy benchmarks and what to fix.

Analytics & Experimentation·Starter#unit-economics#ltv
$ npx skills add unit-economics

// go deeper

The Analytics & Experimentation playbook on aajconsult.com

Interactive tools, methodology, and case studies behind these skills.

// human in the loop

Need a human in the loop?

AAJ builds the strategies, tools, and playbooks these skills are made of — with engagements for growth-stage and enterprise teams.