Webfetch

Fetch and extract text content from a URL

tashfeenahmed Updated

File contents

Web Fetch Skill

Fetch a URL and extract its text content, stripping HTML markup.

When to Use

Use webfetch for:

  • Reading documentation: Fetch API docs, guides
  • Checking web content: Verify what a URL contains
  • Extracting text: Get clean text from HTML pages
  • Fetching data: Download JSON or text data

Input Format

{
  "url": "https://example.com/docs",
  "max_length": 10000
}

Parameters

Parameter Type Required Default Description
url string Yes - URL to fetch (must be http/https)
max_length number No 50000 Max characters to return

Security

  • SSRF protection: blocks private/internal IP ranges
  • Only HTTP and HTTPS URLs allowed
  • 30-second request timeout

Limitations

  • Maximum 50000 characters by default
  • Basic HTML-to-text conversion (no JavaScript rendering)
  • May not work with sites that require authentication

tashfeenahmed/scallopbot/tree/main/src/skills/bundled/webfetch commit 8615e47498

Frequently asked questions

npx skillmds@latest add tashfeenahmed/webfetch