Audit Feedback Loop

Scan the current repository and score its feedback loop maturity for AI-assisted development.

Instructions

Analyze this repository and score its feedback loop maturity using the levels below. Check for each signal, then output a summary report.

Maturity Levels

Level 0 — Vibes No CI config, no linter rules, no CLAUDE.md. The AI agent is flying blind.

Level 1 — Guardrails Has CI + standard linters, but no custom rules. The agent gets basic feedback but can't learn project-specific conventions.

Level 2 — Architecture as Code Has custom lint rules, CLAUDE.md rules have enforcement annotations. The agent gets rich, project-specific feedback.

Level 3 — The Organism Has CI + custom rules + screenshot/visual tests + observability + scheduled agent tasks. The entire development loop is instrumented.

Signals to Check

Scan the repository for the following and note which exist:

1. CI Configuration: Look for .github/workflows/, .circleci/, Jenkinsfile, .gitlab-ci.yml, bitbucket-pipelines.yml, .travis.yml, etc.
2. Linter Config (language-aware):

• JS/TS: eslint.config.*, .eslintrc*, biome.json, .prettierrc*, deno.json
• Python: pyproject.toml (look for [tool.ruff], [tool.pylint], [tool.flake8]), setup.cfg, .flake8, ruff.toml
• Rust: clippy.toml, .clippy.toml, rustfmt.toml
• Go: .golangci.yml, .golangci.yaml
• Ruby: .rubocop.yml
• Java/Kotlin: checkstyle.xml, pmd.xml, detekt.yml

1. Custom Lint Rules: Look for custom plugins, rule directories, or inline rule definitions in linter configs

• JS/TS: eslint-plugin-*, eslint-rules/ directories
• Python: custom Ruff/Pylint plugins, AST-based checks
• Rust: custom Clippy lints
• Go: custom analyzers

1. CLAUDE.md: Check if CLAUDE.md exists at the repo root
2. CLAUDE.md Enforcement: Check if using vigiles v2 specs (CLAUDE.md.spec.ts exists) or v1 annotations (**Enforced by:** in CLAUDE.md). v2 specs = higher maturity.
3. Type-Safe Specs: Check for CLAUDE.md.spec.ts or *.spec.ts files — indicates typed spec compilation via vigiles v2
4. Generated Types: Check for .vigiles/generated.d.ts — indicates linter rules are type-checked at authoring time
5. Screenshot/Visual Tests: Look for Playwright (playwright.config.*), Cypress (cypress.config.*), Chromatic, Percy, BackstopJS configs
6. Observability: Search for imports/usage of @sentry/, dd-trace, @datadog/, newrelic, @opentelemetry/, sentry_sdk, structlog, tracing (Rust), opentelemetry in source files
7. Scheduled Agent Tasks: Look for cron patterns in CI configs, .github/workflows/ with schedule: triggers, or references to scheduled Claude Code tasks

Output Format

## Feedback Loop Audit

**Repository:** 
**Primary language(s):** 
**Score: Level X — **

### Signals Found
- [x] CI Configuration: 
- [ ] Custom Lint Rules: not found
- [x] CLAUDE.md: found, 5 enforced / 2 guidance / 1 missing
...

### Recommendations
1. 
2. 
3. 

### How to Level Up

Be specific about file paths and what you found. Give actionable recommendations tailored to the project's language and toolchain.

Source & license

This open-source skill is cataloged on AgentStack and links to its original source — we do not rehost the code.

• Author: zernie
• Source: zernie/vigiles
• License: MIT
• Homepage: https://vigiles.sh

Install and usage instructions live in the source repository linked above.