agentskillexchange Puppeteer Stealth Web Scraper
Uses puppeteer-extra with stealth plugin to bypass bot detection for web scraping. Integrates with Cheerio for HTML parsing, rotating residential proxies via Bright Data API, and p-queue for concurrency control.
Installation
Use the upstream install or setup path that matches your environment:
- npm i puppeteer # Downloads compatible Chrome during installation.
- npm i puppeteer-core # Alternatively, install as a library, without downloading Chrome.
Basic usage or getting-started notes:
bash npm2yarn
MCP
a Puppeteer-based MCP server for browser automation and debugging.
Extracted from upstream docs: https://raw.githubusercontent.com/puppeteer/puppeteer/HEAD/README.md