How do I install the Firecrawl Crawl skill?

Run npx skillmds@latest add firecrawl/firecrawl-crawl in your terminal (requires Node.js), paste this page's agent-chat prompt into Claude, Cursor, or any MCP-connected agent, or download the SKILL.md file and copy it into your agent's skills directory.

Is Firecrawl Crawl safe to use?

This skill has not completed SkillMD's automated safety review yet. SkillMD never runs a skill's scripts for you; review the SKILL.md before installing.

Which AI agents work with Firecrawl Crawl?

This skill is tagged as working with Claude Code, Claude.ai, OpenAI Codex. SKILL.md is an open format, so most agents that read a skills directory can load it too.

Is Firecrawl Crawl free to use?

Yes. Installing skills from SkillMD is free, and the skill stays under its author's original license.

Who published Firecrawl Crawl?

firecrawl (@firecrawl) published this skill. Their other Agent Skills are listed on their SkillMD profile.

Firecrawl Crawl by firecrawl — Agent Skill

Name: Firecrawl Crawl
Author: firecrawl

Firecrawl Crawl

Bulk extract content from an entire website or site section. Use this skill when the user wants to crawl a site, extract all pages from a docs section, bulk-scrape multiple pages following links, or says "crawl", "get all the pages", "extract everything under /docs", "bulk extract", or needs content from many pages on the same site. Handles depth limits, path filtering, and concurrent extraction.

firecrawl 04716d0 3.0 KB Updated Sep 17, 2026

File contents

firecrawl crawl

Via the Firecrawl MCP (preferred)

This plugin bundles the Firecrawl MCP server. When it's connected, prefer the native firecrawl_crawl tool over the CLI (and firecrawl_check_crawl_status to poll an async crawl) — it needs no local install and authenticates through the plugin's one-time browser sign-in. The firecrawl CLI commands below are the fallback for when the MCP isn't connected.

Bulk extract content from a website. Crawls pages following links up to a depth/limit.

When to use

You need content from many pages on a site (e.g., all /docs/)
You want to extract an entire site section
Step 4 in the workflow escalation pattern: search → scrape → map → crawl → interact

Quick start

# Crawl a docs section
firecrawl crawl "<url>" --include-paths /docs --limit 50 --wait -o .firecrawl/crawl.json

# Full crawl with depth limit
firecrawl crawl "<url>" --max-depth 3 --wait --progress -o .firecrawl/crawl.json

# Check status of a running crawl
firecrawl crawl <job-id>

Options

Option	Description
`--wait`	Wait for crawl to complete before returning
`--progress`	Show progress while waiting
`--limit <n>`	Max pages to crawl
`--max-depth <n>`	Max link depth to follow
`--include-paths <paths>`	Only crawl URLs matching these paths
`--exclude-paths <paths>`	Skip URLs matching these paths
`--delay <ms>`	Delay between requests
`--max-concurrency <n>`	Max parallel crawl workers
`--pretty`	Pretty print JSON output
`-o, --output <path>`	Output file path

Tips

Always use --wait when you need the results immediately. Without it, crawl returns a job ID for async polling.
Use --include-paths to scope the crawl — don't crawl an entire site when you only need one section.
Crawl consumes credits per page. Check firecrawl credit-usage before large crawls.

---name: firecrawl-crawldescription: Bulk extract content from an entire website or site section. Use this skill when the user wants to crawl a site, extract all pages from a docs section, bulk-scrape multiple pages following links, or says "crawl", "get all the pages", "extract everything under /docs", "bulk extract", or needs content from many pages on the same site. Handles depth limits, path filtering, and concurrent extraction.---# firecrawl crawl## Via the Firecrawl MCP (preferred)This plugin bundles the Firecrawl MCP server. When it's connected, prefer the native **`firecrawl_crawl`** tool over the CLI (and **`firecrawl_check_crawl_status`** to poll an async crawl) — it needs no local install and authenticates through the plugin's one-time browser sign-in. The `firecrawl` CLI commands below are the fallback for when the MCP isn't connected.Bulk extract content from a website. Crawls pages following links up to a depth/limit.## When to use- You need content from many pages on a site (e.g., all `/docs/`)- You want to extract an entire site section- Step 4 in the [workflow escalation pattern](firecrawl-cli): search → scrape → map → **crawl** → interact## Quick start```bash# Crawl a docs sectionfirecrawl crawl "<url>" --include-paths /docs --limit 50 --wait -o .firecrawl/crawl.json# Full crawl with depth limitfirecrawl crawl "<url>" --max-depth 3 --wait --progress -o .firecrawl/crawl.json# Check status of a running crawlfirecrawl crawl <job-id>```## Options| Option | Description || ------------------------- | ------------------------------------------- || `--wait` | Wait for crawl to complete before returning || `--progress` | Show progress while waiting || `--limit <n>` | Max pages to crawl || `--max-depth <n>` | Max link depth to follow || `--include-paths <paths>` | Only crawl URLs matching these paths || `--exclude-paths <paths>` | Skip URLs matching these paths || `--delay <ms>` | Delay between requests || `--max-concurrency <n>` | Max parallel crawl workers || `--pretty` | Pretty print JSON output || `-o, --output <path>` | Output file path |## Tips- Always use `--wait` when you need the results immediately. Without it, crawl returns a job ID for async polling.- Use `--include-paths` to scope the crawl — don't crawl an entire site when you only need one section.- Crawl consumes credits per page. Check `firecrawl credit-usage` before large crawls.## See also- [firecrawl-scrape](../firecrawl-scrape/SKILL.md) — scrape individual pages- [firecrawl-map](../firecrawl-map/SKILL.md) — discover URLs before deciding to crawl- [firecrawl-download](../firecrawl-download/SKILL.md) — download site to local files (uses map + scrape)

Frequently asked questions