Check Data Pipeline

Dry-run a preprocessing pipeline on a small sample to catch shape, dtype, value range, padding, special token, label encoding, and collation issues before full training. Writes inline validation code tailored to your pipeline. Invoke this automatically whenever someone is about to start a training run, has changed their dataset or model, or mentions tokenization, padding, shape errors, or collation problems — even if they don't explicitly ask for pipeline validation. Shape/dtype mismatches and label shifts are the most common silent failures in ML pipelines and should always be caught before committing to a full run.

lawwu Updated 3 repo stars

File contents

lawwu/agentic-ml-plugin commit c53d6bfaa1

Frequently asked questions

npx get-skill add lawwu/check-data-pipeline