Robot.txt access disallow mapping Skill
When to activate
- Applying or designing workflows requiring Robot.txt access disallow mapping.
- Implementing code patterns, structures, or configurations related to Robot.txt access disallow mapping.
When NOT to use
- Trivial scripts or unrelated domains where Robot.txt access disallow mapping is not applicable.
Instructions
- Identify project requirements matching Robot.txt access disallow mapping.
- Ensure consistent structure and clean architecture patterns are followed.
- Validate inputs, configurations, and outputs carefully.
Example
// Implement or trigger Robot.txt access disallow mapping rules here