Retrospect
Turn completed-cycle evidence into a better next cycle: benchmark, diagnose,
propose, verify, monitor. No retrospective theatre or one dated log per run.
Scale depth to risk/friction: clean routine cycles may return no change;
substantial runs, escaped defects and repeated human corrections need the full pass.
Evidence boundary
Start from approved spec, run receipts, checks/evals, review/repair history,
human corrections, escaped defects, production observations, routing failures,
resource use and retained artifacts. Use only authorised sources. Mark absent
dimensions unknown; never infer success from a clean final answer.
For substantial+ or repeated cycles, create RETROSPECT.json from the
template. It is evidence, not diary or
project truth. Before closing it, confirm scope names every cycle reviewed and
its profile, each source digest matches its live artifact, each finding cites a
retained source, and status follows the rules below.
Review dimensions
- outcome and acceptance-criteria success;
- trajectory compliance, safety and escaped defects;
- human attention/corrections/rework, gate latency, unnecessary interruption and
blocked time;
- test/eval and reviewer effectiveness;
- orchestration, model routing, delegation, tool reliability;
- context size, compaction, handoff and artifact hygiene;
- skill triggering, usefulness, overlap and missing capability;
- documentation, project memory, canonical-state freshness;
- cost and latency when receipts contain trustworthy measures.
Flywheel
- Benchmark against declared acceptance criteria/eval thresholds, baseline
and comparable runs. Separate output quality from trajectory.
- Diagnose recurring failures by root-cause cluster: product/code,
specification, test/eval, skill, instructions, routing/adapter, tool,
context/memory, documentation or authority/process.
- Propose the smallest change for each supported cluster. Each proposal
names evidence, owner, risk, destination and success measure.
- Verify: turn representative failures into deterministic tests/versioned
eval cases; run regressions before claiming improvement.
- Monitor the next comparable cycle for recurrence, regressions, cost and
new failure modes. Feed supported attention/gate changes into the next scope
cycle, never a parallel process diary.
improved requires authorised intervention, passing regression gate and enough
comparable later cycles meeting predeclared target/guard metrics.
Underpowered or confounded evidence is inconclusive.
Route unclear intent to scope, deterministic defects to implement,
stochastic behaviour to evaluate, skill evidence to skill-craft, and
context cleanup to session or engineering-docs.
Learning and authority
Promote durable conclusions to their canonical owner: spec/ADR, runbook,
project instructions, state/context digest, test/eval fixture, skill or routing
policy. Merge with existing truth; never append a parallel diary. Project facts
never live only in private memory; cross-project preferences follow harness
memory policy.
This skill is proposal-first and read-only by default. Apply project/global
harness changes only under explicit authority or an enclosing implement run;
material cross-project changes return through user-approved scope. Finish with
a table: finding, evidence, root cause, change, regression gate,
owner/destination, status (promote, experiment, defer, reject).
Portable artifact
Use the skill-owned retrospective receipt schema.
1---2name: retrospect3description: Use after delivery, release, incident, evaluation, or a long run to derive evidence-backed process improvements and regression gates. Not for session cleanup, one skill audit, or an active defect; use session, skill-craft, or implement.4---56# Retrospect78Turn completed-cycle evidence into a better next cycle: benchmark, diagnose,9propose, verify, monitor. No retrospective theatre or one dated log per run.10Scale depth to risk/friction: clean routine cycles may return `no change`;11substantial runs, escaped defects and repeated human corrections need the full pass.1213## Evidence boundary1415Start from approved spec, run receipts, checks/evals, review/repair history,16human corrections, escaped defects, production observations, routing failures,17resource use and retained artifacts. Use only authorised sources. Mark absent18dimensions `unknown`; never infer success from a clean final answer.1920For substantial+ or repeated cycles, create `RETROSPECT.json` from the21[template](templates/RETROSPECT.template.json). It is evidence, not diary or22project truth. Before closing it, confirm `scope` names every cycle reviewed and23its profile, each source digest matches its live artifact, each finding cites a24retained source, and `status` follows the rules below.2526## Review dimensions2728- outcome and acceptance-criteria success;29- trajectory compliance, safety and escaped defects;30- human attention/corrections/rework, gate latency, unnecessary interruption and31 blocked time;32- test/eval and reviewer effectiveness;33- orchestration, model routing, delegation, tool reliability;34- context size, compaction, handoff and artifact hygiene;35- skill triggering, usefulness, overlap and missing capability;36- documentation, project memory, canonical-state freshness;37- cost and latency when receipts contain trustworthy measures.3839## Flywheel40411. **Benchmark** against declared acceptance criteria/eval thresholds, baseline42 and comparable runs. Separate output quality from trajectory.432. **Diagnose** recurring failures by root-cause cluster: product/code,44 specification, test/eval, skill, instructions, routing/adapter, tool,45 context/memory, documentation or authority/process.463. **Propose** the smallest change for each supported cluster. Each proposal47 names evidence, owner, risk, destination and success measure.484. **Verify**: turn representative failures into deterministic tests/versioned49 eval cases; run regressions before claiming improvement.505. **Monitor** the next comparable cycle for recurrence, regressions, cost and51 new failure modes. Feed supported attention/gate changes into the next scope52 cycle, never a parallel process diary.5354`improved` requires authorised intervention, passing regression gate and enough55comparable later cycles meeting predeclared target/guard metrics.56Underpowered or confounded evidence is `inconclusive`.5758Route unclear intent to `scope`, deterministic defects to `implement`,59stochastic behaviour to `evaluate`, skill evidence to `skill-craft`, and60context cleanup to `session` or `engineering-docs`.6162## Learning and authority6364Promote durable conclusions to their canonical owner: spec/ADR, runbook,65project instructions, state/context digest, test/eval fixture, skill or routing66policy. Merge with existing truth; never append a parallel diary. Project facts67never live only in private memory; cross-project preferences follow harness68memory policy.6970This skill is proposal-first and read-only by default. Apply project/global71harness changes only under explicit authority or an enclosing `implement` run;72material cross-project changes return through user-approved scope. Finish with73a table: finding, evidence, root cause, change, regression gate,74owner/destination, status (`promote`, `experiment`, `defer`, `reject`).7576## Portable artifact7778Use the skill-owned [retrospective receipt schema](portable-workflow.v1.json).