dvcrn link-checker
Broken link finder that crawls web pages and checks all hyperlinks for HTTP errors (404 Not Found), redirects (301/302), timeouts, and connection failures. Generates detailed reports with status codes, response times, and link locations. Supports recursive crawling with depth control, domain filtering, and multiple output formats. Uses Python3 urllib — no external dependencies. Essential for website maintenance, SEO hygiene, and quality assurance.
Commands
| Command | Description |
|---|---|
check <url> |
Check all links on a single page |
crawl <url> |
Recursively crawl and check links |
report <url> |
Generate a full HTML report |
broken <url> |
Show only broken links |
redirects <url> |
Show only redirected links |
external <url> |
Check only external links |
internal <url> |
Check only internal links |
batch <file> |
Check links on multiple pages |
summary <url> |
Quick summary with counts |
Options
--depth <n>— Crawl depth for recursive mode (default: 1)--timeout <seconds>— Request timeout per link (default: 10)--format text|json|csv|html— Output format (default: text)--output <file>— Save report to file--concurrent <n>— Max concurrent checks (default: 5)--internal-only— Only check internal links--external-only— Only check external links--exclude <pattern>— Exclude URLs matching pattern--verbose— Show all links including OK ones--quiet— Only show broken links--user-agent <string>— Custom User-Agent header
Examples
# Check all links on a page
bash scripts/main.sh check https://example.com
# Find only broken links
bash scripts/main.sh broken https://example.com --format json
# Recursive crawl with depth limit
bash scripts/main.sh crawl https://example.com --depth 2 --internal-only
# Generate HTML report
bash scripts/main.sh report https://example.com --output link-report.html
# Check external links only with custom timeout
bash scripts/main.sh external https://example.com --timeout 15
# Quick summary
bash scripts/main.sh summary https://example.com
Status Categories
| Category | Status Codes | Description |
|---|---|---|
| ✅ OK | 200, 204 | Link is working |
| 🔄 Redirect | 301, 302, 307, 308 | Link redirects |
| ❌ Broken | 404, 410 | Link is dead |
| ⚠️ Error | 403, 500, 502, 503 | Server error |
| ⏱️ Timeout | — | Connection timed out |
| 🚫 Failed | — | Connection refused/DNS failure |
💬 Feedback & Feature Requests: https://bytesagain.com/feedback Powered by BytesAgain | bytesagain.com