# Ab Test Setup

> Design, analyze, and document A/B tests for conversion, onboarding, pricing, lifecycle, and product experiments. Use when the user asks for `/ab-test-setup`, experiment design, sample size, statistical significance, A/B test analysis, ICE-scored test backlogs, or avoiding common testing mistakes.

- **Type:** Skill
- **Install:** `agentstack add skill-eigent-ai-agent-skills-ab-test-setup`
- **Verified:** Yes — security-reviewed for prompt injection and unsafe behavior
- **Seller:** [eigent-ai](https://agentstack.voostack.com/s/eigent-ai)
- **Installs:** 0
- **Category:** [Agent Skills](https://agentstack.voostack.com/c/agent-skills)
- **Latest version:** 0.1.0
- **License:** Apache-2.0
- **Upstream author:** [eigent-ai](https://github.com/eigent-ai)
- **Source:** https://github.com/eigent-ai/agent-skills/tree/main/skills/marketing-and-sales/ab-test-setup
- **Website:** https://www.eigent.ai/skills

## Install

```sh
agentstack add skill-eigent-ai-agent-skills-ab-test-setup
```

Requires the [AgentStack CLI](https://agentstack.voostack.com/docs/cli). Works with Claude Code, Cursor, and any MCP-compatible agent.

## About

# A/B Test Setup

## Overview

Use this skill to guide the full experiment lifecycle: hypothesis, design, sample size, implementation, analysis, and playbook documentation. Keep tests focused, measurable, and resistant to common errors like peeking early or testing too many changes at once.

## Workflow

1. Define the business goal, user segment, current baseline, target metric, and guardrail metrics.
1. Write a specific hypothesis:
   - `If we change X for audience Y, metric Z will improve because...`
1. Design the test:
   - Control and variant.
   - Primary metric.
   - Secondary and guardrail metrics.
   - Traffic split, eligibility, exclusions, and duration.
1. Estimate sample size or minimum detectable effect when baseline traffic and conversion rates are available.
1. Create an implementation checklist:
   - Tracking, randomization, QA, exposure logging, analytics events, and rollback.
1. Define decision rules before launch:
   - Ship, revert, iterate, or continue testing.
1. Analyze results after the test reaches the agreed sample size.
1. Document what changed, what was learned, and follow-up experiments.

## Test Backlog Pattern

When building a backlog, score each idea with ICE:

- Impact: expected business or user benefit.
- Confidence: evidence quality.
- Effort: complexity and implementation cost.

Prioritize tests that combine high impact, credible evidence, and low operational risk.

## Example Prompts

- `I want to A/B test our signup CTA button. Current conversion rate is 3.2%, 8,000 visitors/month. Help me design the test, calculate the required sample size, and define what success looks like.`
- `Our A/B test just hit sample size. Here are the results [paste metrics]. Is this statistically significant? Should we ship the variant, revert, or keep testing?`
- `Build a prioritized A/B test backlog for our onboarding flow. Use ICE scoring. Sources to mine: our drop-off analytics, last month's support tickets, and these 3 heatmap observations.`

## Source & license

This open-source skill is cataloged on AgentStack and links to its original source — we do not rehost the code.

- **Author:** [eigent-ai](https://github.com/eigent-ai)
- **Source:** [eigent-ai/agent-skills](https://github.com/eigent-ai/agent-skills)
- **License:** Apache-2.0
- **Homepage:** https://www.eigent.ai/skills

Install and usage instructions live in the source repository linked above.

## Pricing

- **Free** — Free

## Security capabilities

Automated source analysis of v0.1.0 — what this tool can access:

- **Network access:** no
- **Filesystem access:** no
- **Shell / process execution:** no
- **Environment & secrets:** no
- **Dynamic code execution:** no

*"Yes" means the capability is present in the source — more access means more to trust, not that it is unsafe.*


## Versions

- **0.1.0** — security scan: passed — Imported from the upstream source.

## Links

- Listing page: https://agentstack.voostack.com/l/skill-eigent-ai-agent-skills-ab-test-setup
- Seller: https://agentstack.voostack.com/s/eigent-ai
- Browse the marketplace: https://agentstack.voostack.com/browse

---
Listed on AgentStack — the marketplace for AI agent skills and MCP servers. Every listing is security-reviewed. Creators keep 70%.