Instructions
Scrape and extract readable content from any web page.
Prerequisites
Install dependencies: pip install requests beautifulsoup4
Usage
python {skill_path}/scrape.py URL [--format text|json|links|headings]
Formats:
text(default) — cleaned readable textjson— structured JSON with title, text, links, headingslinks— all links on the pageheadings— all headings (h1–h6)
Examples
- "Read the content of https://example.com"
- "Extract all links from https://news.ycombinator.com"
- "What does this page say? https://some-article.com/post"
Resources
| File | Description |
|---|---|
scrape.py |
Generic web page scraper |