# Web Scraping

> Extract structured data from web pages using CSS selectors and XPath

- Skill: `tatat/web-scraping` (Agent Skill)
- Install (CLI): `npx skillmds@latest add tatat/web-scraping`
- Raw SKILL.md: https://api.skillmd.com/api/skills/tatat/web-scraping/raw
- Safety review: pending
- Works with: Claude Code, Claude.ai, OpenAI Codex
- Category: Web & Frontend
- Author: tatat (https://skillmd.com/u/tatat)
- Updated: 2026-09-22
- Page: https://skillmd.com/skills/tatat/web-scraping

---


# Web Scraping

Extract structured data from web pages.

## Capabilities

- Fetch HTML content from URLs
- Parse and extract specific elements (tables, lists, text)
- Handle pagination
- Output in JSON or CSV format

## Supported Selectors

- CSS selectors: `.class`, `#id`, `tag`
- XPath expressions
- Text patterns (regex)

## Rate Limiting

Always respect robots.txt and implement delays between requests.
Default delay: 1 second between requests.

## Example

```
Scrape product names and prices from example.com/products
Output as JSON with fields: name, price, url
```