# Crawl4AI Open-Source Web Crawling and Markdown Extraction

> Crawl4AI is an open source crawler and scraper built for LLM-ready web extraction, with structured markdown output, browser support, and Python package distribution. It has strong adoption, active maintenance, and a dedicated docs site for integration patterns.

- Skill: `agentskillexchange/crawl4ai-open-source-web-crawling-and-markdown-extraction` (Agent Skill)
- Install (CLI): `npx skillmds@latest add agentskillexchange/crawl4ai-open-source-web-crawling-and-markdown-extraction`
- Raw SKILL.md: https://api.skillmd.com/api/skills/agentskillexchange/crawl4ai-open-source-web-crawling-and-markdown-extraction/raw
- Safety review: pending (external: skill-scanner PASS, skillspector PASS)
- Works with: Claude Code, Claude.ai, OpenAI Codex
- Category: AI & ML
- Author: agentskillexchange (https://skillmd.com/u/agentskillexchange)
- Updated: 2026-09-08
- Page: https://skillmd.com/skills/agentskillexchange/crawl4ai-open-source-web-crawling-and-markdown-extraction

---


# Crawl4AI Open-Source Web Crawling and Markdown Extraction

Crawl4AI is an open source crawler and scraper built for LLM-ready web extraction, with structured markdown output, browser support, and Python package distribution. It has strong adoption, active maintenance, and a dedicated docs site for integration patterns.

## Prerequisites

python, pip, docker, go, rust, java

## Installation

Use the upstream install or setup path that matches your environment:
- pip install -U crawl4ai
- pip install crawl4ai --pre
- Crawl4AI offers flexible installation options to suit various use cases. You can install it as a Python package or use Docker.
- pip install crawl4ai

Requirements and caveats from upstream:
- [![Python Version](https://img.shields.io/pypi/pyversions/crawl4ai)](https://pypi.org/project/crawl4ai/)
- ✨ Previous v0.7.8: Stability & Bug Fix Release! 11 bug fixes addressing Docker API issues, LLM extraction improvements, URL handling fixes, and dependency updates. [Release notes →](https://github.com/unclecode/crawl4...
- **Deploy anywhere**, zero keys, CLI and Docker, cloud friendly

Basic usage or getting-started notes:
- I made it open source for **availability**, anyone can use it without a gate. Now I’m building the platform for **affordability**, anyone can run serious crawls without breaking the bank. If that resonates, join in, s...
- ## 🚀 Quick Start
- # For pre release versions

- Source: https://github.com/unclecode/crawl4ai
- Extracted from upstream docs: https://raw.githubusercontent.com/unclecode/crawl4ai/HEAD/README.md

## Documentation

- https://docs.crawl4ai.com/

## Source

- [Agent Skill Exchange](https://agentskillexchange.com/skills/crawl4ai-open-source-web-crawling-and-markdown-extraction/)