Install
$ agentstack add skill-vaquarkhan-data-engineering-agent-skills-data-catalog-and-discovery ✓ scanned · ✓ verified, works with Claude Code, Cursor, and more.
Security review
✓ PassedNo issues found. Passed automated security review. · v0.1.0 How review works →
- ✓ Prompt-injection patterns
- ✓ Secret / credential exfiltration
- ✓ Dangerous shell & filesystem operations
- ✓ Untrusted network calls
- ✓ Known-malicious package signatures
What it can access
- ✓ Network access No
- ✓ Filesystem access No
- ✓ Shell / process execution No
- ✓ Environment & secrets No
- ✓ Dynamic code execution No
From automated source analysis of v0.1.0. “Used” means the capability is present in the source — more access means more to trust, not that it’s unsafe.
Verified badge
Passed review? Show it. Paste this badge into your README, it links to the public security report.
Reliability & compatibility
Declared compatibility
Compatibility is declared by the source manifest. End-to-end runtime verification is coming, see below.
We're building live execution health for every listing: tool-call success rate, median latency, uptime, and last-checked timestamps, measured, not self-reported. It isn't live yet, so we don't show numbers we can't stand behind.
How agent discovery & health will work →About
Data Catalog And Discovery
Overview
Use this skill when the challenge is not only building data, but making it understandable and discoverable. It helps agents treat metadata, ownership, lineage, and usage context as delivery artifacts instead of afterthoughts.
When to Use
- publishing a new shared dataset
- improving catalog metadata quality
- curating lineage, tags, or ownership information
- reducing duplicate datasets created because teams cannot find trusted ones
Do not stop at filling in a title and description. Discovery quality requires operational context too.
Workflow
- Define the discovery contract.
Include:
- owner
- business description
- technical description
- grain
- freshness expectation
- intended consumers
- Link the asset to its lineage.
Show upstream sources, transformation layers, and major downstream uses where possible.
- Add trust signals.
Typical signals:
- quality status
- SLA or freshness status
- certification or review state
- deprecation state
- Tag for real discovery, not taxonomy theater.
- Revisit metadata when the contract changes.
Common Rationalizations
| Rationalization | Reality | | --- | --- | | "The table name is descriptive enough." | Names alone do not explain grain, trust, or ownership. | | "We can catalog it after people start using it." | Poor discovery usually leads to duplicate local copies first. | | "Lineage is a platform problem, not a delivery problem." | Producers know the business meaning and must help make lineage useful. |
Red Flags
- shared datasets have no owner or description
- certified and experimental assets are indistinguishable
- metadata is copied from schema names without business meaning
- deprecation state is absent for old assets
Verification
- [ ] Ownership, description, grain, and freshness are documented
- [ ] Lineage or source context is attached
- [ ] Trust signals exist for consumers
- [ ] Discovery metadata is updated when the contract changes
Source & license
This open-source skill is cataloged on AgentStack and links to its original source — we do not rehost the code.
- Author: vaquarkhan
- Source: vaquarkhan/data-engineering-agent-skills
- License: MIT
- Homepage: https://vaquarkhan.github.io/data-engineering-agent-skills/
Install and usage instructions live in the source repository linked above.
Reviews
No reviews yet, be the first.
Write a review
Versions
- v0.1.0 Imported from the upstream source.