Mapping Urls

Use when the user wants the list of URLs on a site rather than the page content — sitemap analysis, link planning, or seeding another tool. Covers `crawlberg map URL` with `--limit`, `--search`, robots, output, and how it differs from a full crawl.

xberg-io Updated 9.6k repo stars
Xberg

File contents

xberg-io/crawlberg commit b05ec02981

Frequently asked questions

npx get-skill add xberg-io/mapping-urls-2