# Web Scraper

> Use when needing to crawl websites, capture screenshots, or extract structured data from web pages using headless browsers.

- Skill: `drvivek34/web-scraper` (Agent Skill, multi-file: 2 files)
- Install (CLI): `npx skillmds@latest add drvivek34/web-scraper`
- Raw SKILL.md: https://api.skillmd.com/api/skills/drvivek34/web-scraper/raw
- Safety review: pending
- Works with: Claude Code, Claude.ai, OpenAI Codex
- Category: Coding & Dev Tools
- Author: Drvivek34 (https://skillmd.com/u/drvivek34)
- Updated: 2026-09-17
- Page: https://skillmd.com/skills/drvivek34/web-scraper

---


# Web Scraping Instructions
1. Initialize headless browser (Playwright or Puppeteer).
2. Set user-agent header to avoid bot-detection blocks.
3. Navigate to target URL and wait for selector transitions to complete.
4. Extract innerText or attribute strings.
5. Save extracted records as structured JSON or CSV format.