# Websearch

> Searches DuckDuckGo via its HTML endpoint and outputs results as raw YAML. Uses a deterministic bash script, extracts search results, and prints exact YAML output.

- Skill: `tangledgroup/websearch` (Agent Skill, multi-file: 4 files)
- Install (CLI): `npx skillmds@latest add tangledgroup/websearch`
- Raw SKILL.md: https://api.skillmd.com/api/skills/tangledgroup/websearch/raw
- Safety review: pending
- Works with: Claude Code, Claude.ai, OpenAI Codex
- Category: Web & Frontend
- Author: tangledgroup (https://skillmd.com/u/tangledgroup)
- Updated: 2026-09-17
- Page: https://skillmd.com/skills/tangledgroup/websearch

---


# Web Search — DuckDuckGo to YAML

## Overview

Searches DuckDuckGo via its HTML endpoint `https://html.duckduckgo.com/html/` and outputs results as raw YAML. Final output of skill is complete YAML shown to the user **exactly as produced — never summarized, never transformed**.

A deterministic bash script handles all search execution — the agent always runs `bash scripts/search.sh <query>` and never constructs commands on the fly. This ensures consistent behavior and prevents command-generation errors.

No API key or external service required. Uses `uvx 'scrapling[shell]'` for ephemeral execution — no persistent installs.

## When to Use

- Performing web searches from within an agent workflow
- Research tasks that need exact web search results shown to the user
- Gathering search results as structured YAML

### API Limitations

DuckDuckGo's HTML endpoint has inherent limitations:

- **First page only** — only the top ~10 results are returned
- **No pagination** — there are no additional pages or "next page" links
- **Top results only** — deeper results are not accessible via this endpoint
- **These are the only results available** — do not attempt to fetch more pages or suggest that more results exist

If more results are needed, reformulate the query with different keywords rather than attempting pagination.

## Usage Examples

### Basic Search

Run `search.sh` with a query:

```bash
bash scripts/search.sh "tangled group"
```

The script output is shown to the user exactly as produced — raw YAML:

```yaml
- title: 'Tangled Group, Inc.'
  url: 'https://tangledgroup.com/'
  domain: 'tangledgroup.com'
  snippet: |
    We are a software development company...

- title: 'Tangled Group - LinkedIn'
  url: 'https://www.linkedin.com/company/tangled-group'
  domain: 'linkedin.com'
  snippet: |
    Software engineering services and consulting...

...
```

## Core Concepts

### YAML Output Format

Each result in the YAML output contains these fields (only present if available in the HTML):

- title
- url
- domain
- snippet

### Dependencies

- **bash** — shell scripting
- **uvx** — ephemeral Python package execution (runs `scrapling[shell]`)
- **python3** — query encoding and HTML-to-YAML formatting (builtins only: `html.parser`, `re`, `sys`, `urllib.parse`)