LM Evaluation Harness

Evaluates LLMs across 60+ academic benchmarks (MMLU, HumanEval, GSM8K, TruthfulQA, HellaSwag). Use when benchmarking model quality, comparing models, reporting academic results, or tracking training progress. Industry standard used by EleutherAI, HuggingFace, and major labs. Supports HuggingFace, vLLM, APIs.

agentic-in Updated 586 repo stars
Elephant Agent follows a personal path with people, places, risks, rhythms, decisions, and a Personal Model

File contents

agentic-in/elephant-agent commit 433e7606df

Frequently asked questions

npx get-skill add agentic-in/lm-evaluation-harness