Content Moderation

Two-layer content safety for agent input and output. Use when (1) a user message attempts to override, ignore, or bypass previous instructions (prompt injection), (2) a user message references system prompts, hidden instructions, or internal configuration, (3) receiving messages from untrusted users in group chats or public channels, (4) generating responses that discuss violence, self-harm, sexual content, hate speech, or other sensitive topics, or (5) deploying agents in public-facing or multi-user environments where adversarial input is expected.

knownasnaffy Updated 0 repo stars

File contents

knownasnaffy/prompthound/tree/main/dataset/case_02153 commit a979baa911

Frequently asked questions

npx skillmds@latest add knownasnaffy/content-moderation-2