Firecrawl Crawl

Bulk extract content from an entire website or site section. Use this skill when the user wants to crawl a site, extract all pages from a docs section, bulk-scrape multiple pages following links, or says "crawl", "get all the pages", "extract everything under /docs", "bulk extract", or needs content from many pages on the same site. Handles depth limits, path filtering, and concurrent extraction.

firecrawl Updated 1.3k repo stars

File contents

firecrawl/firecrawl-codex-plugin commit 0f9a893272

Frequently asked questions

npx get-skill add firecrawl/firecrawl-crawl-2