# Fetch

> Public web retrieval and clean extraction engine. Use whenever the user wants to fetch, download, inspect, clean, or save content from a public URL. Supports safe fetching of public web pages, extracts title/text/links, stores results locally, and keeps a job history. No credentials, no login flows, no cloud sync.

- Skill: `dvcrn/fetch` (Agent Skill, multi-file: 10 files)
- Install (CLI): `npx skillmds@latest add dvcrn/fetch`
- Raw SKILL.md: https://api.skillmd.com/api/skills/dvcrn/fetch/raw
- Safety review: pending (external: skill-scanner PASS, skillspector PASS)
- Works with: Claude Code, Claude.ai, OpenAI Codex
- Category: DevOps & Infra
- Author: dvcrn (https://skillmd.com/u/dvcrn)
- Updated: 2026-09-08
- Page: https://skillmd.com/skills/dvcrn/fetch

---


# Fetch

Turn public URLs into usable local content.

## Core Philosophy
1. Fetch only public web content.
2. Prefer clean extracted text over noisy raw HTML.
3. Save both the raw response and structured extraction locally.
4. Keep a simple local job history so previous fetches are easy to inspect.

## Runtime Requirements
- Python 3 must be available as `python3`
- No external packages required

## Safety Boundaries
- Public URLs only
- No login flows
- No cookies or browser automation
- No API keys or credentials
- No external uploads or cloud sync
- All fetched data is stored locally only

## Local Storage
All data is stored under:
- `~/.openclaw/workspace/memory/fetch/jobs.json`
- `~/.openclaw/workspace/memory/fetch/pages/`

## Key Workflows
- **Fetch URL**: `fetch_url.py --url "https://example.com"`
- **Save cleaned output**: `save_output.py --url "https://example.com" --title "Example"`
- **List history**: `list_jobs.py`
- **Show job details**: `show_job.py --id JOB-XXXX`

## Scripts
| Script | Purpose |
|---|---|
| `init_storage.py` | Initialize local storage |
| `fetch_url.py` | Fetch a public URL and extract content |
| `save_output.py` | Save cleaned output with a custom title |
| `list_jobs.py` | List previous fetch jobs |
| `show_job.py` | Show one saved fetch job |