majesticlabs-dev llms.txt Builder
Audience: Site owners wanting AI visibility Goal: Generate llms.txt file for AI system navigation
Related: Use ai-crawler-readiness for the HTTP-layer setup around this file: robots.txt allowlists, Markdown shadow routes, alternate Link headers, content negotiation, and AI-referrer analytics.
What is llms.txt?
A file at https://yoursite.com/llms.txt that helps AI systems understand site structure.
Format
# Site Name
> Brief description of the site and its purpose
## Main Sections
- [Section Name](URL): Description of this section
- [Products](URL): Description of products/services
- [Blog](URL): Description of blog content
## Key Resources
- [Getting Started Guide](URL): Description
- [API Documentation](URL): Description
- [Pricing](URL): Description
## Contact
- Email: contact@example.com
- Support: support@example.com
Best Practices
- Keep descriptions concise (1 sentence each)
- Prioritize most important pages (top 10-15)
- Update when site structure changes
- Include key landing pages for each persona
- Use consistent formatting
Content Priority
Must Include:
- Homepage
- Core product/service pages
- Main category pages
- Contact/support
Should Include:
- Popular blog posts
- Key documentation
- Pricing page
- About/team page
Consider:
- Case studies
- Integration pages
- API docs
- Changelog
Workflow
- Scan site structure (glob for main pages)
- Identify priority pages per section
- Write concise descriptions
- Format as llms.txt
- Validate links work
- Recommend placement in root
Output
# [Site Name]
> [One-line site purpose]
## Main Sections
[3-5 core sections with links]
## Key Resources
[5-10 important pages]
## Contact
[Support channels]