# SEO Sitemap

> Check a domain's robots.txt and XML sitemap health — sitemap declaration, reachability, parseability, and entry count. Use when the user asks about sitemaps, robots.txt, crawlability, or missing pages.

- Skill: `freeautomation-tech/seo-sitemap` (Agent Skill)
- Install (CLI): `npx skillmds@latest add freeautomation-tech/seo-sitemap`
- Raw SKILL.md: https://api.skillmd.com/api/skills/freeautomation-tech/seo-sitemap/raw
- Safety review: pending
- Works with: Claude Code, Claude.ai, OpenAI Codex
- Category: Marketing & Growth
- Author: FreeAutomation-Tech (https://skillmd.com/u/freeautomation-tech)
- Updated: 2026-09-17
- Page: https://skillmd.com/skills/freeautomation-tech/seo-sitemap

---


# Sitemap & robots.txt

Verify a site's sitemap and robots.txt configuration.

## Procedure

1. **Run the sitemap check:**

   ```bash
   python -m seo_kit.crawler.sitemap "<url>"
   ```

   or from Python:

   ```python
   from seo_kit.crawler.sitemap import run_sitemap_check
   result = run_sitemap_check("<url>")
   print(result.to_dict())
   ```

2. **Report:**
   - robots.txt HTTP status (missing = 404, error, or 200 OK)
   - Whether a `Sitemap:` directive is declared
   - Whether the declared sitemap parses, and how many URLs it lists
   - A score (0-100) with findings

3. **Recommend fixes:**
   - Missing robots.txt → provide a minimal `User-agent: *\nAllow: /` + `Sitemap:` line.
   - Missing sitemap directive → add `Sitemap: https://site.com/sitemap.xml`.
   - Empty/small sitemap → ensure canonical pages are listed.

## Notes

- Handles both sitemap indexes and flat `urlset` sitemaps.
- Requires network access to the target domain.
- Inspired by [AgriciDaniel/claude-seo](https://github.com/AgriciDaniel/claude-seo)
  and [seranking/seo-skills](https://github.com/seranking/seo-skills) (both MIT).