Web Scraper

Use when needing to crawl websites, capture screenshots, or extract structured data from web pages using headless browsers.

Drvivek34 31c362b 2 files · 1.0 KB Updated

File contents

Web Scraping Instructions

  1. Initialize headless browser (Playwright or Puppeteer).
  2. Set user-agent header to avoid bot-detection blocks.
  3. Navigate to target URL and wait for selector transitions to complete.
  4. Extract innerText or attribute strings.
  5. Save extracted records as structured JSON or CSV format.

Drvivek34/Skill-Bazaar/tree/main/web-scraping-data/web-scraper commit 31c362baf8

Frequently asked questions

npx skillmds@latest add drvivek34/web-scraper