AgentStack
Browse Sign in
Browse Why AgentStack Sell Docs
Sign in
SKILL verified MIT Self-run

Llms Txt And Crawler Access

skill-wakqasahmed-agentic-commerce-skills-llms-txt-and-crawler-access · by wakqasahmed

Review crawler and AI-agent access files for ecommerce sites, including robots.txt, sitemap, llms.txt, and AI bot rules.

↗ Repository
— No reviews yet
0 installs
28 views
0.0% view→install

Install

$ agentstack add skill-wakqasahmed-agentic-commerce-skills-llms-txt-and-crawler-access

✓ scanned · ✓ verified, works with Claude Code, Cursor, and more.

Security review

✓ Passed

No issues found. Passed automated security review. · v0.1.0 How review works →

  • ✓ Prompt-injection patterns
  • ✓ Secret / credential exfiltration
  • ✓ Dangerous shell & filesystem operations
  • ✓ Untrusted network calls
  • ✓ Known-malicious package signatures

What it can access

  • ✓ Network access No
  • ✓ Filesystem access No
  • ✓ Shell / process execution No
  • ✓ Environment & secrets No
  • ✓ Dynamic code execution No

From automated source analysis of v0.1.0. “Used” means the capability is present in the source — more access means more to trust, not that it’s unsafe.

View the full security report →

Verified badge

Passed review? Show it. Paste this badge into your README, it links to the public security report.

AgentStack Verified badge Links to your public security report.
[![AgentStack Verified](https://agentstack.voostack.com/badges/verified.svg)](https://agentstack.voostack.com/security/report/skill-wakqasahmed-agentic-commerce-skills-llms-txt-and-crawler-access)

Reliability & compatibility

✓ Security review passed
0 installs to date
— no reviews yet
● 2mo ago

Declared compatibility

Claude CodeClaude Desktop

Compatibility is declared by the source manifest. End-to-end runtime verification is coming, see below.

Preview Execution monitoring

We're building live execution health for every listing: tool-call success rate, median latency, uptime, and last-checked timestamps, measured, not self-reported. It isn't live yet, so we don't show numbers we can't stand behind.

How agent discovery & health will work →
Are you the author of Llms Txt And Crawler Access? Claim this listing to set pricing, connect Stripe payouts, and keep 70% of every sale.
Sign up to claim

About

LLMs.txt And Crawler Access

Workflow

  1. Check robots.txt for blocked product/category/policy paths and AI bot rules.
  2. Check sitemap availability, freshness, and product/category coverage.
  3. Check whether llms.txt exists and points to useful public resources.
  4. Check canonical URLs and redirects that may confuse crawlers.
  5. Recommend minimal changes that improve agent discoverability without exposing private areas.

Delegation

This skill is the ecommerce-scoped access review. For depth, delegate to the ai-visibility pack instead of duplicating its work:

  • Full robots/meta-robots/header analysis → robots-ai-crawler-audit.
  • Sitemap coverage, canonicals, and redirect chains → sitemap-discovery-audit.
  • Drafting a new llms.txt → llms-txt-generator.

Guardrails

  • Never recommend opening admin, cart, checkout session, account, or private order paths to crawlers.
  • Keep access recommendations scoped to public storefront evidence.

Source & license

This open-source skill is cataloged on AgentStack and links to its original source — we do not rehost the code.

Install and usage instructions live in the source repository linked above.

Reviews

No reviews yet, be the first.

Write a review

Versions

  • v0.1.0 Imported from the upstream source.

More in Web & Browser