zwright8 Epistemic Semantic Retrieval Ranker
Mission
We need this skill because decisions drift when claims are accepted without verification. This specific skill improves recall precision for downstream decision quality.
Activation Cues
- Task requires semantic relevance scoring in Truth-Seeking and Epistemics.
- Task needs explicit risk controls, approval gates, and traceable outcomes.
- Task output must include artifact handoff for humans and agents.
Execution Plan
- Define the scope and success metrics for
Epistemic Semantic Retrieval Ranker, including at least three measurable KPIs tied to false certainty and unverified assumptions. - Design and version the input/output contract for claims, evidence, and confidence traces, then add schema validation and failure-mode handling.
- Implement the core capability using semantic relevance scoring, and produce ranked retrieval results with deterministic scoring.
- Integrate the skill into swarm orchestration: task routing, approval gates, retry strategy, and rollback controls.
- Add unit, integration, and simulation tests that explicitly cover false certainty and unverified assumptions, then run regression baselines.
- Deploy behind a feature flag, monitor telemetry/alerts for two release cycles, and iterate thresholds based on observed outcomes.
Runbook
Preflight:
- None specified.
Execution:
- None specified.
Recovery:
- None specified.
Handoff:
- None specified.
Guardrails
- [quality] Require validations before promoting outputs.
Success Metrics
- Primary metric: false certainty
- Secondary metrics: unverified assumptions, decision drift
- Review cadence: weekly
Output Contract
- Return a concise execution summary with key decisions.
- Return risk and mitigation notes with unresolved blockers.
- Return artifact target:
ranked retrieval results. - Return recommended follow-up tasks for next wave execution.