How do I install the Anansi skill?

Run npx skillmds@latest add undermybelt/anansi in your terminal (requires Node.js), paste this page's agent-chat prompt into Claude, Cursor, or any MCP-connected agent, or download the SKILL.md file and copy it into your agent's skills directory.

Is Anansi safe to use?

This skill has not completed SkillMD's automated safety review yet. SkillMD never runs a skill's scripts for you; review the SKILL.md before installing.

Which AI agents work with Anansi?

This skill is tagged as working with Claude Code, Claude.ai, OpenAI Codex. SKILL.md is an open format, so most agents that read a skills directory can load it too.

Is Anansi free to use?

Yes. Installing skills from SkillMD is free. This skill is licensed under Apache-2.

Who published Anansi?

undermybelt (@undermybelt) published this skill. Their other Agent Skills are listed on their SkillMD profile.

Anansi by undermybelt — Agent Skill

Name: Anansi
Author: undermybelt

Anansi

Use the reviewed Anansi adaptive web scraping framework for authorized web fetch, extraction, crawl, selector healing, browser rendering, screenshot, and MCP-driven scraping workflows. Use when the user mentions Anansi, self-healing selectors, adaptive scraping, anti-bot scraping, crawler repair, crawl_site, or LLM-driven crawling.

undermybelt 65bb9bc 2.2 KB Updated Sep 17, 2026

File contents

Anansi

Use this skill for authorized adaptive web scraping with the reviewed Anansi source tree.

Scope

Source root: ~/.hermes/external-repos/anansi.
Package name: anansi-scraper; import package: anansi.
Capabilities: HTTP fetch, browser rendering, adaptive selector healing, crawl queue, structured extraction, screenshots, exports, and MCP server tools.

Safety Rules

Only scrape sites the operator is authorized to access.
Respect robots.txt, target terms, rate limits, privacy law, and data rights.
Do not start the MCP server, run browser automation, install Playwright browsers, configure proxies, or enable TLS/anti-bot impersonation unless the user explicitly asks for that operation.
Do not enable ANANSI_ALLOW_PRIVATE_NETWORKS=1 unless the user explicitly requests it for a trusted isolated host.
Prefer ANANSI_DISABLE_ANTIBOT=1 for ordinary fetch/extract use unless the user explicitly asks for authorized anti-bot handling.
Keep exports confined to the working project or Anansi's ~/.anansi/exports/ path.

Install When Needed

Use a local virtual environment in the user's working project:

. ~/.hermes/skills/devops/anansi/.venv/bin/activate

Browser support is separate and should be explicit:

playwright install chromium

TLS impersonation support is separate and should be explicit:

pip install "~/.hermes/external-repos/anansi[tls]"

First Probes

ANANSI_DISABLE_ANTIBOT=1 ~/.hermes/skills/devops/anansi/.venv/bin/python -m anansi --help
ANANSI_DISABLE_ANTIBOT=1 ~/.hermes/skills/devops/anansi/.venv/bin/python -m anansi.mcp_server.server --help

Common Commands

ANANSI_DISABLE_ANTIBOT=1 ~/.hermes/skills/devops/anansi/.venv/bin/anansi fetch https://example.com --output markdown

ANANSI_DISABLE_ANTIBOT=1 ~/.hermes/skills/devops/anansi/.venv/bin/anansi mcp

---name: anansidescription: Use the reviewed Anansi adaptive web scraping framework for authorized web fetch, extraction, crawl, selector healing, browser rendering, screenshot, and MCP-driven scraping workflows. Use when the user mentions Anansi, self-healing selectors, adaptive scraping, anti-bot scraping, crawler repair, crawl_site, or LLM-driven crawling.license: Apache-2.0---# AnansiUse this skill for authorized adaptive web scraping with the reviewed Anansi source tree.## Scope- Source root: `~/.hermes/external-repos/anansi`.- Package name: `anansi-scraper`; import package: `anansi`.- Capabilities: HTTP fetch, browser rendering, adaptive selector healing, crawl queue, structured extraction, screenshots, exports, and MCP server tools.## Safety Rules- Only scrape sites the operator is authorized to access.- Respect robots.txt, target terms, rate limits, privacy law, and data rights.- Do not start the MCP server, run browser automation, install Playwright browsers, configure proxies, or enable TLS/anti-bot impersonation unless the user explicitly asks for that operation.- Do not enable `ANANSI_ALLOW_PRIVATE_NETWORKS=1` unless the user explicitly requests it for a trusted isolated host.- Prefer `ANANSI_DISABLE_ANTIBOT=1` for ordinary fetch/extract use unless the user explicitly asks for authorized anti-bot handling.- Keep exports confined to the working project or Anansi's `~/.anansi/exports/` path.## Install When NeededUse a local virtual environment in the user's working project:```bash. ~/.hermes/skills/devops/anansi/.venv/bin/activate```Browser support is separate and should be explicit:```bashplaywright install chromium```TLS impersonation support is separate and should be explicit:```bashpip install "~/.hermes/external-repos/anansi[tls]"```## First Probes```bashANANSI_DISABLE_ANTIBOT=1 ~/.hermes/skills/devops/anansi/.venv/bin/python -m anansi --helpANANSI_DISABLE_ANTIBOT=1 ~/.hermes/skills/devops/anansi/.venv/bin/python -m anansi.mcp_server.server --help```## Common Commands```bashANANSI_DISABLE_ANTIBOT=1 ~/.hermes/skills/devops/anansi/.venv/bin/anansi fetch https://example.com --output markdown``````bashANANSI_DISABLE_ANTIBOT=1 ~/.hermes/skills/devops/anansi/.venv/bin/anansi mcp```

Frequently asked questions

Anansi

File contents

Anansi

Scope

Safety Rules

Install When Needed

First Probes

Common Commands

Related skills

Frequently asked questions

How do I install the Anansi skill?

What does the Anansi skill do?

Is Anansi safe to use?

Which AI agents work with Anansi?

Is Anansi free to use?

Who published Anansi?