Web Crawler

Bounded, privacy-aware website and sitemap crawler with AgentConfig-managed egress, TLS, output confinement, and optional GraphOS document ingestion. Use when fetching one page, crawling a site or sitemap, or ingesting approved web content into GraphOS.

Knuckles-Team Updated 5 repo stars

File contents

Knuckles-Team/universal-skills commit 57a56132d1

Frequently asked questions

npx get-skill add knuckles-team/web-crawler