Web Forager

Web Forager

[](https://pypi.org/project/web-forager/) [](https://pypi.org/project/web-forager/) [](https://opensource.org/licenses/MIT) [](https://pepy.tech/project/web-forager) [](https://skills.sh/CyranoB/web-forager)

The thing about information on the web is that it doesn't want to be found. It wants to hide behind cookie banners, keep itself to itself, and generally behave like a cat that knows it's time for the vet. Web Forager is the sort of dogged, slightly grubby assistant who goes out there anyway — accompanied by a duck of questionable temperament — rummages through DuckDuckGo, grabs pages directly when it can, and calls in Jina Reader when things get complicated. The results come back neatly converted for LLM consumption, which is to say, in a format that would make a librarian weep with either joy or despair, depending on the librarian.

Web Forager gives AI agents practical web research workflows as Agent Skills. The skills search DuckDuckGo, monitor news, fetch pages, and synthesize cited answers.

Default usage is skill-first. You do not need to configure an MCP server to use the research workflows.

Quickstart

Install all five skills with one command. It works for 50+ coding agents:

npx skills@latest add CyranoB/web-forager

The installer detects your agents, asks which skills you want, and places them in the right location.

Common variations:

npx skills@latest add CyranoB/web-forager --list
npx skills@latest add CyranoB/web-forager --skill deep-research
npx skills@latest add CyranoB/web-forager --skill '*' -a claude-code -a codex -y

Install For Your Coding Tool

Install as skills/plugins when your agent supports them. Use MCP only when your tool does not support skills, or when you want raw search/fetch tools instead of guided research workflows.

Claude Code

Install all five skills from the plugin marketplace:

/plugin marketplace add CyranoB/web-forager
/plugin install forager-skills@web-forager

Restart Claude Code, then check /skills.

The Quickstart command above is also available as a cross-agent install path.

MCP-only fallback:

claude mcp add --transport stdio web-forager -- uvx --python ">=3.10,

Codex

Install the skills for the current project:

```bash
npx skills@latest add CyranoB/web-forager -a codex

Install globally instead:

npx skills@latest add CyranoB/web-forager -a codex -g

MCP-only fallback:

codex mcp add web-forager -- uvx --python ">=3.10,

VS Code / GitHub Copilot

If your VS Code build supports agent plugins, use the command palette:

1. Open `Cmd+Shift+P` on macOS or `Ctrl+Shift+P` on Windows/Linux.
2. Run `Chat: Install Plugin From Source`.
3. Paste `https://github.com/CyranoB/web-forager`.

MCP-only fallback: configure a local MCP server with the standard config below.

Gemini CLI

Install the skills for the current project:

```bash
npx skills@latest add CyranoB/web-forager -a gemini-cli

Install globally instead:

npx skills@latest add CyranoB/web-forager -a gemini-cli -g

MCP-only fallback:

gemini mcp add web-forager uvx --python ">=3.10,

Pi Coding Agent

Install the skills for the current project:

```bash
npx skills@latest add CyranoB/web-forager -a pi

Install globally instead:

npx skills@latest add CyranoB/web-forager -a pi -g

For one-off sessions from a local checkout, pass a skill path explicitly:

pi --skill web-forager/skills/deep-research

MCP-only fallback: configure a local MCP server with the standard config below.

Kiro CLI

Install the skills for the current workspace:

npx skills@latest add CyranoB/web-forager -a kiro-cli

Install globally instead:

npx skills@latest add CyranoB/web-forager -a kiro-cli -g

Kiro's default agent loads skills from both locations automatically. For custom agents, add skill resources such as:

{
  "resources": [
    "skill://.kiro/skills/*/SKILL.md",
    "skill://~/.kiro/skills/*/SKILL.md"
  ]
}

Cursor, OpenCode, Cline, Windsurf, JetBrains

Use the standard MCP config below unless your client supports Agent Skills or plugins from a GitHub repository. If it does, install from:

https://github.com/CyranoB/web-forager

Individual Skills

For any Agent Skills-compatible tool, install one skill by name:

npx skills@latest add CyranoB/web-forager --skill deep-research

Direct skill URLs also work:

npx skills@latest add https://github.com/CyranoB/web-forager/tree/main/skills/deep-research

Use The Skills

After installing, ask your agent naturally. The matching skill should be selected automatically by skill metadata.

Examples:

Research the current state of open-source browser agents.
Fact check: did Apple announce a foldable iPhone?
What's new with Anthropic this month?
Map the competitive landscape for AI meeting assistants.
Should we adopt Bun for a production Node service?

Available Skills

| Skill | Use it for | Output | | --- | --- | --- | | [deep-research](skills/deep-research/) | General research, lookups, deep dives | Adaptive report with citations | | [fact-check](skills/fact-check/) | Verifying a specific claim | Verdict with supporting and contradicting evidence | | [news-monitor](skills/news-monitor/) | Recent news and updates | Chronological briefing | | [competitive-intel](skills/competitive-intel/) | Market maps and competitor analysis | Landscape or positioning report | | [tech-advisor](skills/tech-advisor/) | Tech/product evaluation and adoption decisions | Recommendation with evidence |

How Search Works

The skills prefer tools in this order:

1. Existing MCP search/fetch tools, if your agent already has them.
2. Built-in agent web search/fetch tools.
3. The packaged Web Forager CLI through uvx.
4. A direct ddgs fallback through uv run --no-project.

Python 3.10-3.13 is supported. Python 3.14 is not supported yet, so all documented uvx commands pin `--python ">=3.10,=3.10,=3.10,=3.10,=3.10,<3.14" web-forager fetch "https://example.com" --format markdown

Or install locally:

```bash
uv pip install web-forager
web-forager search "your search query"
web-forager news "your topic"
web-forager fetch "https://example.com"

MCP Tools

The MCP server exposes:

| Tool | Purpose | | --- | --- | | duckduckgo_search | Search the web with DuckDuckGo-compatible results | | duckduckgo_news_search | Search recent news with dates and sources | | web_fetch | Fetch a URL and return markdown or JSON |

Search and news tools return JSON by default and support output_format="text" for LLM-friendly formatted results.

Development

git clone https://github.com/CyranoB/web-forager.git
cd web-forager
uv pip install -e ".[dev]"
pytest

Useful local commands:

web-forager serve
web-forager version --debug

Notes

• Search and news search use the ddgs package.
• Fetch tries direct HTTP plus trafilatura first, then falls back to Jina Reader

for JavaScript-heavy or bot-protected pages.

• The plugin marketplace manifest lives in .claude-plugin/marketplace.json.

License

MIT. See [LICENSE](LICENSE).

Source & license

This open-source MCP server is cataloged on AgentStack and links to its original source — we do not rehost the code.

• Author: CyranoB
• Source: CyranoB/web-forager
• License: MIT

Install and usage instructions live in the source repository linked above.