# 434 Firecrawl Policy Guardrails 4a48f641

> firecrawl-policy-guardrails

- Skill: `tools-only/434-firecrawl-policy-guardrails-4a48f641` (Agent Skill, multi-file: 3 files)
- Install (CLI): `npx skillmds@latest add tools-only/434-firecrawl-policy-guardrails-4a48f641`
- Raw SKILL.md: https://api.skillmd.com/api/skills/tools-only/434-firecrawl-policy-guardrails-4a48f641/raw
- Safety review: pending
- Works with: Claude Code, Claude.ai, OpenAI Codex
- Category: Productivity
- Author: tools-only (https://skillmd.com/u/tools-only)
- Updated: 2026-09-22
- Page: https://skillmd.com/skills/tools-only/434-firecrawl-policy-guardrails-4a48f641

---

# firecrawl-policy-guardrails

## Skill Scaffold

```
firecrawl-policy-guardrails/
  SKILL.md
```

## File Descriptions

### 1. SKILL.md
**Purpose:** Implement robots.txt compliance, rate limiting policies, content filtering, and ethical scraping guardrails.
**Workflow:** Compliance skill - ensures scraping operations are ethical, legal, and respect target site policies.
**Relates to:** Extends firecrawl-security-basics; supports firecrawl-data-handling for responsible data use

## Summary

This skill implements ethical and legal guardrails for web scraping. It covers robots.txt parsing and compliance, respecting crawl-delay directives, domain blocklists for protected content, rate limiting to avoid site disruption, noindex/nofollow respect, terms of service awareness, and content licensing considerations. These guardrails ensure scraping operations are responsible, legal, and maintain good standing with content providers.