Constitutional Classifiers

Screen an agent's input and output against a policy you write, so it refuses the content classes you disallow without over-refusing the ones you allow. Covers writing a constitution that lists allowed and disallowed content for your app, screening user input before the model and model output before delivery, generating synthetic examples from the constitution to test and harden the screen, setting a stricter policy for an autonomous agent than for a chat assistant, and tracking the over-block rate. Use this when someone needs content guardrails on an agent, wants to block a category of request or output, hardens an agent against jailbreaks, or deploys an agent in an abuse-prone or regulated domain. Trigger on "content policy for my agent," "block disallowed output," "jailbreak defense," "input and output filtering," and similar. This is policy screening of agent I/O; keeping the agent from obeying instructions hidden in the content it reads is defending-against-prompt-injection.

Hoja-Solutions 09a05ec 3.5 KB Updated

File contents

Hoja-Solutions/agent-stdlib/tree/main/skills/constitutional-classifiers commit 09a05ec393

Frequently asked questions

npx skillmds@latest add hoja-solutions/constitutional-classifiers