Huggingface Huggingface Community Evals

Run evaluations for Hugging Face Hub models using inspect-ai and lighteval on local hardware. Use for backend selection, local GPU evals, and choosing between vLLM / Transformers / accelerate. Not for HF Jobs orchestration, model-card PRs, .eval_results publication, or community-evals automation.

pyfagorass Updated 2 repo stars

File contents

pyfagorass/bookofspells commit 34db2fa643

Frequently asked questions

npx get-skill add pyfagorass/huggingface-huggingface-community-evals