Generate LLMs Catalog
Regenerate static/llms.txt and static/catalog.json from all documentation
content files. These files provide machine-readable indexes of the Bactopia
documentation for LLM consumption.
llms.txtfollows the llms.txt standardcatalog.jsonprovides structured metadata (title, description, tags, URL) per page
Steps
1. Run the generator
python bin/generate-llms-catalog.py
Or via Make:
make llms-catalog
The script walks all 6 content areas (docs, bactopia-tools, bactopia-pipelines,
developers, impact, blog), parses YAML frontmatter from each .md/.mdx file,
and generates both output files.
Expected output:
Collecting Bactopia...
7 pages
Collecting Bactopia Tools...
70 pages
Collecting Bactopia Pipelines...
4 pages
Collecting Developers...
230 pages
Collecting Impact & Outreach...
5 pages
Collecting Blog...
2 pages
Wrote static/llms.txt
Wrote static/catalog.json
Total: 318 pages across 6 sections
2. Verify output
Check that both files were generated correctly:
static/llms.txt-- should have# Bactopiaheading, blockquote tagline, section headings matching the navbar, and one- [Title](URL): descriptionentry per pagestatic/catalog.json-- should be valid JSON withsite,generated,total_pages, andsectionsarray. Each section should havepageswithtitle,description,url,path,tags, andsource_file
3. Build check
Run npm run build to confirm the site builds with the new static files.
Both should be served at the site root:
https://bactopia.io/llms.txthttps://bactopia.io/catalog.json