Security: OWASP LLM Top 10
Purpose
Map the LLM data flow and review each applicable OWASP LLM category with concrete abuse cases. The release verdict must rely on tests and controls, not expected model behaviour.
Scope and evidence
- Read
references/owasp-llm-top10.md. - Map the LLM data flow: user input → preprocessing → prompt assembly → retrieval/embedding → model call → output handling → downstream effect. Note where untrusted data crosses into prompt context.
- Identify the model(s), provider(s), tool(s), and the agent's permitted actions.
- Use Context7 MCP for the current OWASP LLM Top 10 wording and the current model-provider security guidance (Anthropic, OpenAI, Google, Mistral, Meta, etc.).
Assessment
- For each LLM Top 10 category, mark status: Pass / Concern / Fail / Out-of-scope.
- Build an abuse-case list per category: e.g., direct prompt injection, indirect via retrieved doc, system-prompt leakage probe, jailbreak via tool description, exfil via embedding inversion, denial via context blow-up.
- Verify each abuse case with an eval: at least 10 representative prompts per category, multiple seeds, varied phrasing, plus at least one obfuscated/encoded variant.
- Cross-check with
security-owasp-agenticfor autonomy/agency risk and withsecurity-secretsfor prompt content secrets handling. - Produce remediation plan, owner per finding, and a release-gate verdict with conditions.
Safety rules
- Use Context7 MCP for current LLM Top 10 categories, provider safety docs, and any model-card limitations.
- Keep a decision trace: model version, evaluator method, abuse-case coverage, what is not yet tested.
- Refuse to mark a category Pass without an eval run, not just a code review.
- Escalate any unmitigated Excessive Agency or Sensitive Information Disclosure finding before release.
Security record
- LLM data-flow diagram (sources, sinks, trust boundaries)
- Per-category status table with eval evidence
- Abuse-case eval results (counts, rates, examples)
- Findings register with owners
- Release-gate verdict and conditions
Release criteria
- No category marked Pass from prompt review alone; require eval evidence.
- No mitigation that relies on "the model usually refuses". Require deterministic guardrail evidence.
- No retrieval pipeline approved without an injection test through ingested content.
- No tool-using agent approved without an excessive-agency review.
Handoff
Hand off to service-implementation per finding and to qa-eval to add the abuse-case evals into the regression suite.
References
references/owasp-llm-top10.md: per-category checklist, abuse-case patterns, and provider-specific notes.