Crawlee Smart Crawler Agent

Implements intelligent web crawling using the Crawlee framework with adaptive request routing between CheerioCrawler and PlaywrightCrawler. Manages request queues, handles anti-bot challenges, and exports structured data.

agentskillexchange Updated 28 repo stars

File contents

agentskillexchange/skills/tree/main/skills/crawlee-smart-crawler-agent commit bec645dff1

Frequently asked questions

npx skillmds@latest add agentskillexchange/crawlee-smart-crawler-agent