Forge playbook — AI chatbot / RAG
Do not duplicate ECC skills — defer to: agentdb-vector-search / agentdb-memory-patterns (vector store), docs-lookup (SDK docs), learn-codebase (grounding on a repo), claude-api (if Anthropic-based).
Hard rules
- Grounding: answers are source-aware and cite their sources.
- Clear fallback response when retrieval is empty/low-confidence — no guessing.
- No hallucinated business facts (names, prices, contacts, claims).
- Safe data handling; conversation logging on; a defined human-handoff path.
- Lead capture is consent-aware; secrets/API keys in env only.
Team (conditional)
Lead: architect. Specialists: mle-reviewer (pipeline/serving), python-reviewer / typescript-reviewer, security-reviewer, database-reviewer (vector store).
Skills / commands / MCP
agentdb-vector-search, docs-lookup, learn-codebase; claude-api reference for model IDs/params if using Claude. security-reviewer on the serving layer.
Fan-out & flow
L3 typical. Parallel: ingestion/embeddings pipeline ∥ chat/retrieval layer ∥ frontend. Serial: system prompt → retrieval → fallback → safety eval.
Domain gates
System prompt reviewed; retrieval + embeddings correct; ingestion idempotent; citations present; fallback verified; no invented facts; logging + handoff defined; an eval set on known Q/A.
Ship-readiness (unique)
Fallback verified for empty/low-confidence retrieval; answers cite sources; no invented business info; PII + keys in env; logging on; handoff tested; regression eval run. The ship-readiness AI/RAG checklist is advisory; optionally run codex-reviewer (Codex) on important code — not a blocker.
Untrusted-content injection defense (scout #4, 2026-07-13 — patterns from arXiv 2506.08837, CC-BY-4.0)
Structural (not just behavioral) handling of scraped/retrieved/inbound untrusted content. Risk REDUCTION, never "provably safe":
- Plan-Then-Execute: the owning Boss commits the extraction plan (which fields/answers it needs) BEFORE ingesting any untrusted page/doc/webhook/transcript, so injected text cannot change WHICH actions run.
- Reader-side capability-split (Map-Reduce): dispatch untrusted-content ingestion as a dedicated tool-restricted READER subagent whose frontmatter grants
tools: Read, WebFetch, Grep, GlobONLY (no Write/Edit/Bash/SendMessage/external-send). It returns a VALIDATED structured summary (fields + provenance), never free-form passthrough; the acting Boss consumes that summary and performs any writes/sends. One lean subagent per source. - Honest limit: Forge's Lead is itself a Claude reading content, so true doer-blindness (full Dual-LLM) is not enforceable — this is the reader-side/weak form. Draft-only outreach already covers the external-send leg of the lethal trifecta.