Puppeteer Web Scraping Pipeline

Builds web scraping pipelines with Puppeteer using page.evaluate, page.waitForSelector, and browser.newPage. Handles infinite scroll, cookie consent banners, and anti-bot detection with stealth plugin.

agentskillexchange Updated 28 repo stars

File contents

Puppeteer Web Scraping Pipeline

Builds web scraping pipelines with Puppeteer using page.evaluate, page.waitForSelector, and browser.newPage. Handles infinite scroll, cookie consent banners, and anti-bot detection with stealth plugin.

Installation

Use the upstream install or setup path that matches your environment:

  • npm i puppeteer # Downloads compatible Chrome during installation.
  • npm i puppeteer-core # Alternatively, install as a library, without downloading Chrome.

Basic usage or getting-started notes:

Documentation

Source

agentskillexchange/skills/tree/main/skills/puppeteer-web-scraping-pipeline commit a2e0ad333e

Frequently asked questions

npx skillmds@latest add agentskillexchange/puppeteer-web-scraping-pipeline