LLM Assisted Curation

Use locally-hosted LLMs (vLLM/SGLang) for dataset filtering, quality scoring, rewriting, labeling, and synthetic data generation. Covers LLM-as-judge scoring, structured output filtering, batch inference pipelines, and 2025-2026 techniques (DataRater, perplexity filtering, curriculum scoring, LLM-based dedup).

mkurman Updated 327 repo stars
Picture from the README

File contents

mkurman/zorai commit c1bc7b74a5 Runs: mkurman/embedding-analysis

Frequently asked questions

npx get-skill add mkurman/llm-assisted-curation