# Pilot Analysis

> Use this skill to compute and inspect ACP metrics, telemetry, and export outputs for intervention and baseline cycles without overclaiming.

- **Type:** Skill
- **Install:** `agentstack add skill-jasontang-ai-acp-pilot-analysis`
- **Verified:** Yes — security-reviewed for prompt injection and unsafe behavior
- **Seller:** [jasontang-ai](https://agentstack.voostack.com/s/jasontang-ai)
- **Installs:** 0
- **Category:** [Data & Analytics](https://agentstack.voostack.com/c/data-and-analytics)
- **Latest version:** 0.1.0
- **License:** Apache-2.0
- **Upstream author:** [jasontang-ai](https://github.com/jasontang-ai)
- **Source:** https://github.com/jasontang-ai/acp/tree/main/skills/pilot-analysis

## Install

```sh
agentstack add skill-jasontang-ai-acp-pilot-analysis
```

Requires the [AgentStack CLI](https://agentstack.voostack.com/docs/cli). Works with Claude Code, Cursor, and any MCP-compatible agent.

## About

# What this skill is for

Use this skill when a pilot, benchmark, or rehearsal needs condition-comparable analysis rather than raw cycle inspection.

# When to use it

- Summarizing one or more cycles.
- Comparing intervention and baseline conditions.
- Preparing pilot evidence for operator or reviewer handoff.

# When not to use it

- Do not use it to manage lifecycle transitions.
- Do not use it to author participant content.
- Do not convert prototype metrics into field-efficacy claims.

# Inputs expected

- One or more cycle ids or cycle JSON files
- Condition labels
- Optional export mode
- Claim boundary for the analysis

# Preflight / prerequisites

1. Confirm cycles are comparable.
2. Confirm exports and metrics are generated by Relay.
3. Separate benchmark evidence, pilot evidence, and field-efficacy claims.

# Workflow

1. Run one-cycle metric summaries.
2. Run condition comparison when at least two cycles exist.
3. Inspect missing metrics and telemetry gaps.
4. Summarize only what the evidence supports.
5. Call out non-claims explicitly.

# Decision rules / judgment criteria

- Comparable denominators matter more than impressive numbers.
- Missing telemetry is a gap.
- Synthetic benchmark evidence supports operational feasibility, not field efficacy.
- Baseline and intervention condition counts should remain aligned where the scenario requires it.

# Escalation rules

Escalate when intervention and baseline differ in participant or contribution count unexpectedly, when key metrics are missing, or when a requested claim exceeds the evidence class.

# Available scripts

- `scripts/metrics-summary.mjs `
- `scripts/compare-cycles.mjs   [...]`

# Outputs

- Metrics summary
- Condition comparison
- Explicit evidence gaps
- Claim-safe analysis notes

# Failure handling

If telemetry is incomplete, report incompleteness and stop short of numeric inference.

# Trust / safety notes

Pilot analysis is vulnerable to overclaiming. Treat every output as a bounded evidence artifact.

# Composition notes

Use inside `pilot-cycle-review` and `foresight-submission-prep`.

# Examples to inspect next

Read `examples/casebook.md` for condition comparison and overclaiming anti-patterns.

# Evaluation hooks

Run `scripts/metrics-summary.mjs`, `scripts/compare-cycles.mjs`, and `npm run skills:audit`.

## Source & license

This open-source skill is cataloged on AgentStack and links to its original source — we do not rehost the code.

- **Author:** [jasontang-ai](https://github.com/jasontang-ai)
- **Source:** [jasontang-ai/acp](https://github.com/jasontang-ai/acp)
- **License:** Apache-2.0

Install and usage instructions live in the source repository linked above.

## Pricing

- **Free** — Free

## Security capabilities

Automated source analysis of v0.1.0 — what this tool can access:

- **Network access:** no
- **Filesystem access:** no
- **Shell / process execution:** no
- **Environment & secrets:** no
- **Dynamic code execution:** no

*"Yes" means the capability is present in the source — more access means more to trust, not that it is unsafe.*


## Versions

- **0.1.0** — security scan: passed — Imported from the upstream source.

## Links

- Listing page: https://agentstack.voostack.com/l/skill-jasontang-ai-acp-pilot-analysis
- Seller: https://agentstack.voostack.com/s/jasontang-ai
- Browse the marketplace: https://agentstack.voostack.com/browse

---
Listed on AgentStack — the marketplace for AI agent skills and MCP servers. Every listing is security-reviewed. Creators keep 70%.