Web Crawler

Bounded, relevance-guided crawl from seed URLs. Use to map a site or follow a topic across pages without unbounded fetching — frontier kept in check by depth, count, and domain rules.

SAMRADDHASHRIVASTAVATECH Updated 0 repo stars

File contents

SAMRADDHASHRIVASTAVATECH/veyron-skill-and-mcp-pack commit af935470e7

Frequently asked questions

npx get-skill add samraddhashrivastavatech/web-crawler