Robots Txt

Use when applies to any public website. Use when auditing technical SEO foundations or diagnosing crawl coverage gaps.

thedaviddias Updated 74.7k repo stars

File contents

thedaviddias/front-end-checklist commit 1cd019ae27

Frequently asked questions

npx get-skill add thedaviddias/robots-txt