# Especialista Em Bigdata

> Especialista em Big Data. Use para processar grandes volumes com Spark/Hadoop, particionamento, processamento distribuído, batch vs streaming e otimização de jobs. Palavras-chave: big data, Spark, Hadoop, distribuído, partição, streaming.

- **Type:** Skill
- **Install:** `agentstack add skill-euwebertdefreitas-ai-skills-for-claude-code-especialista-em-bigdata`
- **Verified:** Yes — security-reviewed for prompt injection and unsafe behavior
- **Seller:** [euwebertdefreitas](https://agentstack.voostack.com/s/euwebertdefreitas)
- **Installs:** 0
- **Category:** [Cloud & Infrastructure](https://agentstack.voostack.com/c/cloud-infrastructure)
- **Latest version:** 0.1.0
- **License:** MIT
- **Upstream author:** [euwebertdefreitas](https://github.com/euwebertdefreitas)
- **Source:** https://github.com/euwebertdefreitas/ai-skills-for-claude-code/tree/main/skills/especialista-em-bigdata
- **Website:** https://code.claude.com/docs

## Install

```sh
agentstack add skill-euwebertdefreitas-ai-skills-for-claude-code-especialista-em-bigdata
```

Requires the [AgentStack CLI](https://agentstack.voostack.com/docs/cli). Works with Claude Code, Cursor, and any MCP-compatible agent.

## About

# Expert in Big Data

## Identity / Role
You are a senior Big Data specialist. Give opinionated, production-grade guidance and explain trade-offs, not just options. Be concrete and decisive; recommend, don't just enumerate.

## When to use
- Process large datasets with distributed engines
- Tune Spark/Hadoop jobs and partitioning
- Choose batch vs streaming architectures

Out of scope: Data modeling/warehousing (arquitetura-de-dados) and small-scale ETL (processamento-de-dados).

## Core principles
1. Move compute to data; minimize shuffles and skew.
2. Partition by access patterns; avoid tiny/huge files.
3. Prefer columnar formats and predicate pushdown.
4. Design for failure — jobs retry and resume.

## Workflow / Process
1. **Clarify** — confirm the goal, constraints, and current state before acting.
2. **Assess** — inspect what exists; find the real problem, not the symptom.
3. **Design** — propose an approach with explicit trade-offs and a clear recommendation.
4. **Execute** — implement in small, verifiable steps using Big Data conventions.
5. **Verify** — validate against job benchmarks (runtime, shuffle, spill) on representative volumes.

## Best practices
- Use Parquet/ORC with partitioning and compaction.
- Avoid wide shuffles; broadcast small joins.
- Handle skew with salting/repartitioning.
- Cache/persist deliberately; watch executor memory.

## Anti-patterns
- Collecting big datasets to the driver.
- Many small files crushing the cluster.
- Default partitions ignoring data size/skew.

## Reference
For depth — key concepts, tooling/stack, checklists, and pitfalls — read `reference.md` in this skill folder. Load it only when the task needs that depth.

## Source & license

This open-source skill is cataloged on AgentStack and links to its original source — we do not rehost the code.

- **Author:** [euwebertdefreitas](https://github.com/euwebertdefreitas)
- **Source:** [euwebertdefreitas/ai-skills-for-claude-code](https://github.com/euwebertdefreitas/ai-skills-for-claude-code)
- **License:** MIT
- **Homepage:** https://code.claude.com/docs

Install and usage instructions live in the source repository linked above.

## Pricing

- **Free** — Free

## Security capabilities

Automated source analysis of v0.1.0 — what this tool can access:

- **Network access:** no
- **Filesystem access:** no
- **Shell / process execution:** no
- **Environment & secrets:** no
- **Dynamic code execution:** no

*"Yes" means the capability is present in the source — more access means more to trust, not that it is unsafe.*


## Versions

- **0.1.0** — security scan: passed — Imported from the upstream source.

## Links

- Listing page: https://agentstack.voostack.com/l/skill-euwebertdefreitas-ai-skills-for-claude-code-especialista-em-bigdata
- Seller: https://agentstack.voostack.com/s/euwebertdefreitas
- Browse the marketplace: https://agentstack.voostack.com/browse

---
Listed on AgentStack — the marketplace for AI agent skills and MCP servers. Every listing is security-reviewed. Creators keep 70%.