# Gen2WebText

> Derivative of DLoggedWebTextPlus that starts from one URL, extracts content-focused links and summaries, and logs outputs using CommonCode FolderNavigator into datastore3 mine/domain/yyyy/mm/dd.

- Skill: `davesteadman/gen2webtext` (Agent Skill, multi-file: 4 files)
- Install (CLI): `npx skillmds@latest add davesteadman/gen2webtext`
- Raw SKILL.md: https://api.skillmd.com/api/skills/davesteadman/gen2webtext/raw
- Safety review: pending
- Works with: Claude Code, Claude.ai, OpenAI Codex
- Category: Coding & Dev Tools
- Author: DaveSteadman (https://skillmd.com/u/davesteadman)
- Updated: 2026-09-10
- Page: https://skillmd.com/skills/davesteadman/gen2webtext

---


# Gen2WebText

Gen2 derivative of DLoggedWebTextPlus, with centralized folder resolution via `CommonCode/FolderNavigator.py`.

## Execution

python gen2_web_text.py <domain> <url> --max-links <number> --words <number> --timeout-ms <milliseconds>

## Arguments

- domain required alphabetic string only A-Z or a-z
- url required start URL
- --max-links optional default 8 range 1 to 25
- --words optional default 200 range 80 to 400
- --timeout-ms optional default 15000

## Output

On success returns JSON with:
- domain
- url
- start_page_summary
- start_page_words
- links_processed
- results with rank, anchor_text, url, page_summary, page_words, page_status
- log_path
- status

On error returns JSON with:
- domain
- url
- error
- results
- links_processed
- log_path
- status

## Logging

Writes to:
{OPENCLAW_ROOT}/data/datastore3/01-Mine/<domain>/YYYY/MM/DD/{PageName}.txt

Path resolution is handled by `FolderNavigator.from_fixed_point()` and `get_today_path(area="mine", domain=..., create=True)`.

