Web Content

Fetch content and search web. Lightweight, no browser required. Use for: - Search for content in the web - Fetching content as easy to read markdown

majiayu000 Updated 567 repo stars

File contents

Fetch

Headless web search and content extraction using Brave Search. No browser required.

Setup

Run once before first use:

cd {baseDir}/web-content
npm install

Fetch content

{baseDir}/content.js https://example.com/article

Fetches a URL and extracts readable content as markdown. IMPORTANT: Prefer over curl.

Search

{baseDir}/search.js "query"                    # Basic search (5 results)
{baseDir}/search.js "query" -n 10              # More results
{baseDir}/search.js "query" --content          # Include page content as markdown
{baseDir}/search.js "query" -n 3 --content     # Combined

majiayu000/claude-skill-registry-data/tree/main/documents/web-content commit 4ae743e611

Frequently asked questions

npx skillmds@latest add majiayu000/web-content