# Semantic Consistency Auditor

> Audits deep semantic alignment between mission, statement, rubric, reference solution, and tests. Use when artifacts may be structurally valid but pedagogically inconsistent.

- Skill: `alainlebret/semantic-consistency-auditor` (Agent Skill)
- Install (CLI): `npx skillmds@latest add alainlebret/semantic-consistency-auditor`
- Raw SKILL.md: https://api.skillmd.com/api/skills/alainlebret/semantic-consistency-auditor/raw
- Safety review: pending
- Works with: Claude Code, Claude.ai, OpenAI Codex
- Category: Coding & Dev Tools
- Author: alainlebret (https://skillmd.com/u/alainlebret)
- Updated: 2026-09-17
- Page: https://skillmd.com/skills/alainlebret/semantic-consistency-auditor

---


# Semantic Consistency Auditor

## Goal
Detect semantic mismatches that pass schema checks but break assessment validity or grading fairness.

## Inputs
- `mission.json`
- `statement.md`
- `rubric.md`
- `teacher-notes.md`
- Optional `reference/` and `tests/`

## Produce
Write `semantic-consistency-report.json` with:
- `overall_status` (`pass`|`review`|`fail`)
- `findings` (id, severity, artifact, evidence, remediation)
- `coverage_matrix` (learning outcomes x rubric criteria x tasks/tests)
- `leakage_risks` (teaching/exam mismatch, hidden prerequisites, rubric blind spots)
- `fairness_risks` (ambiguous wording, non-deterministic grading, time-budget mismatch)

## Mandatory checks
- Every assessed task maps to at least one declared learning outcome.
- Every rubric criterion maps to observable evidence in statement or expected outputs.
- Teacher notes do not introduce criteria absent from rubric.
- Tests (if present) verify intended competencies and do not overfit incidental details.
- Time/difficulty estimate is consistent with mission constraints.

## Severity policy
- `fail`: invalidates grading integrity (missing alignment, contradictory criteria, impossible constraints).
- `review`: ambiguous but potentially salvageable.
- `pass`: no blocking inconsistency detected.

## Rules
- Prioritize evidence-based findings over style feedback.
- Report concrete remediation steps, not generic advice.
- Never mutate source artifacts; emit audit only.