Firecrawl Markdown Capture Pipeline
Captures clean site content through Firecrawl endpoints like /v1/scrape, /v1/map, and /v1/crawl, with Markdown output for downstream agents. Great for turning messy websites into reliable research corpora, docs snapshots, or retrieval-ready source material.
Installation
Requirements and caveats from upstream:
- python
- Node.js
Basic usage or getting-started notes:
Sign up at firecrawl.dev to get your API key. Try the playground to test it out.
Search
Search the web and get full content from results.
Extracted from upstream docs: https://raw.githubusercontent.com/firecrawl/firecrawl/HEAD/README.md