Web Fetch

Fetch and extract readable content from web pages. Use for lightweight page access without browser automation.

majiayu000 Updated 567 repo stars

File contents

Web Fetch

Fetch and extract readable content from web pages using curl and basic text processing.

Usage

Important: Scripts are located relative to this skill's base directory.

When you see this skill in <available_skills>, note the <base_dir> path.

# General pattern:
bash "<base_dir>/scripts/fetch.sh" <url> [output_file]

# Example (replace <base_dir> with actual path from skill listing):
bash "~/chatgpt-on-wechat/skills/web-fetch/scripts/fetch.sh" "https://example.com"

Parameters:

  • url: The HTTP/HTTPS URL to fetch (required)
  • output_file: Optional file to save the output (default: stdout)

Returns:

  • Extracted page content with title and text

Examples

Fetch a web page

bash "<base_dir>/scripts/fetch.sh" "https://example.com"

Save to file

bash "<base_dir>/scripts/fetch.sh" "https://example.com" output.txt
cat output.txt

Notes

  • Uses curl for HTTP requests (timeout: 10s)
  • Extracts title and basic text content
  • Removes HTML tags and scripts
  • Works with any standard web page
  • No external dependencies beyond curl

majiayu000/claude-skill-registry-data/tree/main/integration/web-fetch commit 39315fb009

Frequently asked questions

npx skillmds@latest add majiayu000/web-fetch