# Crawlee Web Crawling and Browser Automation Library

> Builds scalable web collection pipelines with Crawlee, Apify’s open-source crawling and browser automation library. Useful for request queue management, Playwright or Puppeteer crawling, structured dataset export, and resilient scraping across large sets of pages.

- Skill: `agentskillexchange/crawlee-web-crawling-and-browser-automation-library` (Agent Skill)
- Install (CLI): `npx skillmds@latest add agentskillexchange/crawlee-web-crawling-and-browser-automation-library`
- Raw SKILL.md: https://api.skillmd.com/api/skills/agentskillexchange/crawlee-web-crawling-and-browser-automation-library/raw
- Safety review: pending (external: skill-scanner PASS, skillspector PASS)
- Works with: Claude Code, Claude.ai, OpenAI Codex
- Category: AI & ML
- Author: agentskillexchange (https://skillmd.com/u/agentskillexchange)
- Updated: 2026-09-08
- Page: https://skillmd.com/skills/agentskillexchange/crawlee-web-crawling-and-browser-automation-library

---


# Crawlee Web Crawling and Browser Automation Library

Builds scalable web collection pipelines with Crawlee, Apify’s open-source crawling and browser automation library. Useful for request queue management, Playwright or Puppeteer crawling, structured dataset export, and resilient scraping across large sets of pages.

## Installation

Use the upstream install or setup path that matches your environment:
- npx crawlee create my-crawler
- npm start
- npm install crawlee playwright
- npm install crawlee@next

Requirements and caveats from upstream:
- Do you prefer 🐍 Python instead of JavaScript? [👉 Checkout Crawlee for Python 👈](https://github.com/apify/crawlee-python).
- Crawlee requires **Node.js 16 or higher**.

Basic usage or getting-started notes:
- We recommend visiting the [Introduction tutorial](https://crawlee.dev/js/docs/introduction) in Crawlee documentation for more information.
- ### With Crawlee CLI
- The fastest way to try Crawlee out is to use the **Crawlee CLI** and choose the **Getting started example**. The CLI will install all the necessary dependencies and add boilerplate code for you to play with.

- Source: https://github.com/apify/crawlee
- Extracted from upstream docs: https://raw.githubusercontent.com/apify/crawlee/HEAD/README.md

## Source

- [Agent Skill Exchange](https://agentskillexchange.com/skills/crawlee-web-crawling-browser-automation-library/)