Crawl Site

Crawl a website's pages with Firecrawl to inventory content, find broken links, or gather a corpus. Use when the agent needs to understand a site's structure, find all pages under a path, or collect a set of pages for analysis.

HiAi-gg Updated 1 repo stars

File contents

HiAi-gg/agent-plugins commit 0929eea68c

Frequently asked questions

npx get-skill add hiai-gg/crawl-site