# Ghostfetch

> Stealthy web fetching for AI agents. Bypasses blocks on X.com and other sites to return clean Markdown. Use when this capability is needed.

- Skill: `tomevault-io/ghostfetch` (Agent Skill, multi-file: 2 files)
- Install (CLI): `npx skillmds@latest add tomevault-io/ghostfetch`
- Raw SKILL.md: https://api.skillmd.com/api/skills/tomevault-io/ghostfetch/raw
- Safety review: pending (external: skill-scanner PASS, skillspector PASS)
- Works with: Claude Code, Claude.ai, OpenAI Codex
- Category: Docs & Writing
- Author: tomevault-io (https://skillmd.com/u/tomevault-io)
- Updated: 2026-09-17
- Page: https://skillmd.com/skills/tomevault-io/ghostfetch

---


# GhostFetch

GhostFetch is a stealthy headless browser service designed specifically for AI agents. It bypasses anti-bot protections (like those on X/Twitter) and returns clean, LLM-friendly Markdown.

## Installation

GhostFetch is already in your workspace at the repo root. To use it as a skill, ensure the Python environment is set up from the repo directory:

```bash
python3 -m venv venv
source venv/bin/activate
pip install -r requirements.txt
playwright install chromium
```

## Usage

You can use GhostFetch in two ways:

### 1. Direct CLI (Recommended for quick fetches)
Use the scraper module directly to get Markdown from a URL.

```bash
python3 -m src.core.scraper "https://x.com/user/status/123"
```

### 2. API Mode (Background service)
Start the FastAPI server to handle concurrent jobs and webhooks.

```bash
# Start server
python3 main.py

# Fetch via API
curl -X POST "http://localhost:8000/fetch" \
  -H "Content-Type: application/json" \
  -d '{"url": "https://x.com/user/status/123"}'
```

## Stealth Features
- **Ghost Protocol**: Advanced proxy rotation and hardware fingerprinting.
- **X.com Optimized**: Specific logic to wait for dynamic tweet content.
- **LLM Ready**: Automatic HTML-to-Markdown conversion.

---
*Created by Syed Arsalan Shah (@iArsalanshah)*

---
> Converted and distributed by [TomeVault](https://tomevault.io/claim/iarsalanshah) — claim your Tome and manage your conversions.
<!-- tomevault:4.0:skill_md:2026-04-11 -->