Web Crawl

Crawl/scrape a website or single page into clean LLM-ready MARKDOWN. Use when the user wants to fetch a URL's content, scrape a site, extract an article/page as text, pull docs from the web into the wiki, or "crawl this link". Markdown (not raw HTML) = 5-10x fewer tokens. Built-now- adapt-later: works offline with no key via a builtin urllib→markdown backend; premium backends (Firecrawl/Crawl4AI/Jina) are a one-config adapter.

rheinmir Updated 11 repo stars

File contents

rheinmir/setup commit 9ab82aa3b3

Frequently asked questions

npx get-skill add rheinmir/web-crawl