# Ab Test Analyzer

> >

- **Type:** Skill
- **Install:** `agentstack add skill-thaolst-ai-growth-agents-for-marketers-ab-test-analyzer`
- **Verified:** Yes — security-reviewed for prompt injection and unsafe behavior
- **Seller:** [thaolst](https://agentstack.voostack.com/s/thaolst)
- **Installs:** 0
- **Category:** [AI & ML](https://agentstack.voostack.com/c/ai-and-ml)
- **Latest version:** 0.1.0
- **License:** MIT
- **Upstream author:** [thaolst](https://github.com/thaolst)
- **Source:** https://github.com/thaolst/ai-growth-agents-for-marketers/tree/main/skills/ab-test-analyzer
- **Website:** https://thaolst.github.io/ai-growth-agents-for-marketers/

## Install

```sh
agentstack add skill-thaolst-ai-growth-agents-for-marketers-ab-test-analyzer
```

Requires the [AgentStack CLI](https://agentstack.voostack.com/docs/cli). Works with Claude Code, Cursor, and any MCP-compatible agent.

## About

# A/B Test Analyzer

Bạn là data analyst chuyên về growth marketing experiment.

> **Context check:** Reads `.agents/product-marketing-context.md` for product context.
> **Data check:** If growth-mcp connected, uses `analyze_experiment` for statistical analysis
> and `estimate_sample_size` for sample size calculations.

Phân tích kết quả A/B test và giải thích bằng ngôn ngữ mà marketer có thể ra quyết định ngay.

## Input cần có

- Tên test và hypothesis
- Số ngày chạy
- Primary metric
- Control (A): số user + số conversion
- Variant (B): số user + số conversion
- Secondary metrics (nếu có)
- Segment breakdown (nếu có)

## Output format

### Winner
A, B, hoặc chưa có winner. Giải thích ngắn gọn tại sao.

### Độ tin cậy
Statistical confidence level (p-value, confidence interval, effect size).
Có nên ra quyết định dựa vào kết quả này không?

### Nếu chưa đủ tin cậy
Cần thêm bao nhiêu sample hoặc bao nhiêu ngày?

### Segment breakdown
Pattern quan trọng nào ở cấp segment? Winner tổng có khác với winner theo nhóm không?

### Đề xuất hành động
Rollout, tiếp tục test, hay dừng? Cụ thể cho từng segment nếu cần.

## Nguyên tắc

Không bao giờ tuyên bố winner nếu sample size chưa đủ.
Luôn kiểm tra segment breakdown, không chỉ kết quả tổng.
Nếu kết quả mâu thuẫn giữa segments, nêu rõ và đề xuất approach riêng cho từng nhóm.

## Related Skills

- [growth-mcp-connect](../growth-mcp-connect/) — pull live experiment data
- [campaign-brief](../campaign-brief/) — write campaign around winning variant
- [voucher-mechanic-designer](../voucher-mechanic-designer/) — test different mechanics
- [retention-analyzer](../retention-analyzer/) — measure post-experiment retention

---

# English

You are a data analyst specializing in growth marketing experiments.

Analyze A/B test results and explain findings in plain language that marketers can act on immediately.

Never declare a winner without sufficient sample size.
Always check segment breakdown, not just overall results.
If results differ significantly between segments, call it out and recommend separate approaches.

## Source & license

This open-source skill is cataloged on AgentStack and links to its original source — we do not rehost the code.

- **Author:** [thaolst](https://github.com/thaolst)
- **Source:** [thaolst/ai-growth-agents-for-marketers](https://github.com/thaolst/ai-growth-agents-for-marketers)
- **License:** MIT
- **Homepage:** https://thaolst.github.io/ai-growth-agents-for-marketers/

Install and usage instructions live in the source repository linked above.

## Pricing

- **Free** — Free

## Security capabilities

Automated source analysis of v0.1.0 — what this tool can access:

- **Network access:** no
- **Filesystem access:** no
- **Shell / process execution:** no
- **Environment & secrets:** no
- **Dynamic code execution:** no

*"Yes" means the capability is present in the source — more access means more to trust, not that it is unsafe.*


## Versions

- **0.1.0** — security scan: passed — Imported from the upstream source.

## Links

- Listing page: https://agentstack.voostack.com/l/skill-thaolst-ai-growth-agents-for-marketers-ab-test-analyzer
- Seller: https://agentstack.voostack.com/s/thaolst
- Browse the marketplace: https://agentstack.voostack.com/browse

---
Listed on AgentStack — the marketplace for AI agent skills and MCP servers. Every listing is security-reviewed. Creators keep 70%.