Check Eval

Evaluates a model checkpoint using HF Trainer.evaluate(), lm-evaluation-harness, or a custom eval script. Loads the checkpoint, runs evaluation, parses results, computes deltas against a baseline, and produces a structured results report. Run this automatically after training completes or a checkpoint is saved to gate progression to the next lifecycle stage.

lawwu Updated 3 repo stars

File contents

lawwu/agentic-ml-plugin commit a73f575bcf

Frequently asked questions

npx get-skill add lawwu/check-eval