jefflyt Mandate 2.2.4 Code Static Evaluation Skill
Mandate
- ID: 2.2.4
- Title: Vector Database and Embedding Security
Mitigates
- LLM08 Vector and Embedding Weaknesses
- ASI06 Memory and Context Poisoning
- MCP03 Memory Poisoning
Inputs
- Repository root path.
- Tech stack/language map.
- Optional architecture notes if provided.
Workflow
- Scope relevant code surfaces tied to this mandate.
- Run mandate-specific static checks and trace source-to-sink/control paths.
- Extract exact evidence with file/line references.
- Classify each control as implemented, partial, or missing.
- Produce partial-confidence findings and list required runtime/process evidence for closure.
Mandate-Specific Static Method
- Locate vector DB client and retrieval code paths.
- Verify tenant/session filters are mandatory in every retrieval/update query.
- Detect shared/global namespaces that bypass tenant boundaries.
- Verify embedding metadata includes tenant/user ownership tags.
- Verify authorization checks occur before vector query execution.
- Emit findings for cross-tenant retrieval risk paths.
Output Contract
Return a single structured result with:
- mandate_id, mandate_title
- static_status: implemented|partial|missing
- confidence: low|medium|high (static-only confidence)
- evidence: list of file/line findings
- gaps: unresolved items requiring operational proof
- next_evidence_requests: runtime/process artifacts needed
Guardrails
- Avoid final compliance pass/fail using code alone.
- Mark assumptions explicitly.
- Prefer deterministic checks over heuristics when possible.