MoirAI evaluation judgement
Use this skill when the user needs a pass-or-rework decision backed by runtime evidence.
- Convert the request into observable acceptance criteria and identify required inputs, state, artifacts, and existing golden baseline.
- Compile first. Use topology inspection when graph shape is part of the claim.
- Use deterministic prediction to examine planned flow, never as proof of model quality or persisted output.
- Use run, trace, and checkpoint evidence for actual execution. Resolve any
agent_required state through the current host's native protocol before claiming completion.
- Inspect artifacts only when the run requested and materialized them.
- Apply golden evaluation only to an existing baseline. Failed, stale, missing, malformed, or unevaluated cases do not pass.
Return criterion, action, expected result, observed result, evidence location, and verdict for each item. Finish with one overall pass, rework, or blocked decision and the smallest justified next step.
Attribute every rework: route structural defects to design (moirai-clotho) and contract or implementation defects to authoritative repair (moirai-lachesis), and say which must move first when both apply. A blocked decision names the exact missing baseline, input, state, artifact request, or host capability. Never return an unattributed judgement such as "the output looks weak", and never collapse several independent root causes into one paragraph — each gets its own line, its own evidence, and its own owner.
The shared discipline in working discipline governs the escalation order and the evidence rules this verdict rests on.
1---2name: moirai-eval-judgement3description: Judge a graph skill against explicit criteria using prediction, execution, trace, artifact, and existing golden evidence.4---56# MoirAI evaluation judgement78Use this skill when the user needs a pass-or-rework decision backed by runtime evidence.9101. Convert the request into observable acceptance criteria and identify required inputs, state, artifacts, and existing golden baseline.112. Compile first. Use topology inspection when graph shape is part of the claim.123. Use deterministic [prediction](references/KB-08-predict.md) to examine planned flow, never as proof of model quality or persisted output.134. Use [run, trace, and checkpoint evidence](references/KB-09-run-trace-checkpoint.md) for actual execution. Resolve any `agent_required` state through the current host's native protocol before claiming completion.145. Inspect [artifacts](references/KB-14-artifacts-persistence.md) only when the run requested and materialized them.156. Apply [golden evaluation](references/KB-10-golden.md) only to an existing baseline. Failed, stale, missing, malformed, or unevaluated cases do not pass.1617Return criterion, action, expected result, observed result, evidence location, and verdict for each item. Finish with one overall `pass`, `rework`, or `blocked` decision and the smallest justified next step.1819Attribute every `rework`: route structural defects to design (`moirai-clotho`) and contract or implementation defects to authoritative repair (`moirai-lachesis`), and say which must move first when both apply. A `blocked` decision names the exact missing baseline, input, state, artifact request, or host capability. Never return an unattributed judgement such as "the output looks weak", and never collapse several independent root causes into one paragraph — each gets its own line, its own evidence, and its own owner.2021The shared discipline in [working discipline](references/KB-15-working-discipline.md) governs the escalation order and the evidence rules this verdict rests on.