Build Eval Dataset

Use this to build a good evaluation dataset for an LLM app, the part everyone underestimates. Trigger on "make an eval set", "what should I test my LLM on", "I don't have test data for my prompt", "build a golden dataset", or before setting up evals. A great eval set beats a great metric; garbage-in means your evals lie to you.

ContextJet-ai Updated 49 repo stars

File contents

ContextJet-ai/awesome-llm-observability commit f196851b01

Frequently asked questions

npx get-skill add contextjet-ai/build-eval-dataset