# Data Validator

> Autonomous data quality validation — schema inference and validation, completeness/uniqueness/consistency checks, statistical anomaly detection, time-series gap detection, referential integrity, dataset comparison and drift detection. Supports CSV, JSON, SQLite, APIs. Use after any data pipeline work.

- **Type:** Skill
- **Install:** `agentstack add skill-jansenanalytics-claudex-data-validator`
- **Verified:** Yes — security-reviewed for prompt injection and unsafe behavior
- **Seller:** [JansenAnalytics](https://agentstack.voostack.com/s/jansenanalytics)
- **Installs:** 0
- **Category:** [Databases](https://agentstack.voostack.com/c/databases)
- **Latest version:** 0.1.0
- **License:** MIT
- **Upstream author:** [JansenAnalytics](https://github.com/JansenAnalytics)
- **Source:** https://github.com/JansenAnalytics/claudex/tree/main/skills/data-validator

## Install

```sh
agentstack add skill-jansenanalytics-claudex-data-validator
```

Requires the [AgentStack CLI](https://agentstack.voostack.com/docs/cli). Works with Claude Code, Cursor, and any MCP-compatible agent.

## About

# data-validator

Autonomous data quality validation for any data source — databases, CSVs, APIs, JSON files.

## Quick Start

```bash
data-validator /path/to/data.csv --infer          # Auto-detect schema & validate
data-validator /path/to/data.csv --schema s.json   # Validate against schema
data-validator /path/to/data.csv --full            # All checks including timeseries
```

## Binary: `~/bin/data-validator`

```
data-validator [command]  [options]
```

### Commands
| Command | Description |
|---------|-------------|
| `review` (default) | Full orchestrated validation |
| `schema` | Schema validation / inference |
| `quality` | Data quality scoring |
| `compare` | Diff two datasets |
| `integrity` | Referential integrity checks |
| `timeseries` | Time-series specific analysis |
| `report` | Generate report from results JSON |

### Sources
- `file.csv` — CSV with headers
- `file.json` — JSON array of objects
- `file.jsonl` / `file.ndjson` — Newline-delimited JSON
- `sqlite:/path/to/db.sqlite:tablename` — SQLite table
- `http://api/endpoint` — JSON API

### Options
| Option | Description |
|--------|-------------|
| `--schema FILE` | Schema JSON to validate against |
| `--infer` | Auto-infer schema from data |
| `--compare FILE2` | Compare with second dataset |
| `--timeseries` | Run time-series analysis |
| `--time-field NAME` | Specify time field |
| `--primary-key NAME` | Primary key field (default: id) |
| `--quick` | Schema + quality only |
| `--full` | All checks |
| `--output-dir DIR` | Write individual reports to directory |
| `--format md\|json` | Output format |
| `--output FILE` | Output file (per-script) |

## Schema Format

```json
{
  "fields": {
    "id": { "type": "integer", "required": true, "unique": true, "min": 1 },
    "email": { "type": "string", "required": true, "pattern": "^[^@]+@[^@]+$" },
    "amount": { "type": "number", "min": 0, "max": 1000000 },
    "status": { "type": "enum", "values": ["active", "inactive", "pending"] },
    "created_at": { "type": "date", "format": "ISO8601", "after": "2020-01-01" },
    "tags": { "type": "array", "minLength": 1, "itemType": "string" }
  }
}
```

## Quality Dimensions

The quality score (0-100) is computed from:
- **Completeness** — % populated fields, flags >5% nulls
- **Validity** — Schema conformance per field
- **Consistency** — Format consistency, encoding
- **Accuracy** — Outlier detection (>3σ from mean)
- **Timeliness** — Gap detection in time-series data
- **Integrity** — Referential integrity, FK violations

## Scripts

| Script | Purpose |
|--------|---------|
| `schema.cjs` | Schema inference & validation |
| `quality.cjs` | Quality scoring (completeness, uniqueness, accuracy, distribution) |
| `compare.cjs` | Dataset diff & drift detection |
| `integrity.cjs` | FK violations, orphans (SQLite + file relationships) |
| `timeseries.cjs` | Gaps, duplicates, monotonicity, anomalies, staleness |
| `review.cjs` | Orchestrator — runs all checks |
| `report.cjs` | Report generator (MD + JSON) |

## Dependencies

- Node.js (built-in modules only, except better-sqlite3 for SQLite)
- `better-sqlite3` (only for SQLite sources) — shared from the kanban-agent skill's `node_modules` (`${CLAUDE_SKILLS_DIR:-$HOME/.claude-agent/.claude/skills}/kanban-agent/node_modules`). See INSTALL.md.

## Source & license

This open-source skill is cataloged on AgentStack and links to its original source — we do not rehost the code.

- **Author:** [JansenAnalytics](https://github.com/JansenAnalytics)
- **Source:** [JansenAnalytics/claudex](https://github.com/JansenAnalytics/claudex)
- **License:** MIT

Install and usage instructions live in the source repository linked above.

## Pricing

- **Free** — Free

## Security capabilities

Automated source analysis of v0.1.0 — what this tool can access:

- **Network access:** no
- **Filesystem access:** no
- **Shell / process execution:** no
- **Environment & secrets:** no
- **Dynamic code execution:** no

*"Yes" means the capability is present in the source — more access means more to trust, not that it is unsafe.*


## Versions

- **0.1.0** — security scan: passed — Imported from the upstream source.

## Links

- Listing page: https://agentstack.voostack.com/l/skill-jansenanalytics-claudex-data-validator
- Seller: https://agentstack.voostack.com/s/jansenanalytics
- Browse the marketplace: https://agentstack.voostack.com/browse

---
Listed on AgentStack — the marketplace for AI agent skills and MCP servers. Every listing is security-reviewed. Creators keep 70%.