Annotate Traces For Review

Use this to set up human review and annotation of LLM traces, so people (often domain experts) can label outputs, do error analysis, and build a trustworthy golden dataset. Trigger on "review my LLM outputs", "have an expert label these", "error analysis", "annotate traces", "build a golden dataset", or when automated evals are not enough for a high-stakes or specialized domain. Looking at your data is the highest-ROI thing you can do.

ContextJet-ai Updated 49 repo stars

File contents

ContextJet-ai/awesome-llm-observability commit fa22a31931

Frequently asked questions

npx get-skill add contextjet-ai/annotate-traces-for-review