Huggingface Community Evals

Codex curated Hugging Face skill for preparing, running, and packaging community evaluation tasks and benchmark submissions.

Rycen7822 Updated

File contents

huggingface-community-evals

When to Use

Use for Hugging Face community eval harnesses, benchmark task packaging, eval metadata, result validation, or leaderboard-oriented workflows.

Do Not Use When

Do not use for ordinary unit-test debugging or PDF visual checks.

Required Inputs

Evaluation task, dataset, metric, expected submission format, and any leaderboard constraints.

Workflow

  1. Inspect eval specification.
  2. Prepare data and task config.
  3. Run or validate evaluation.
  4. Package results with reproducibility notes.

Rycen7822/skill-retrieval-mcp/tree/main/tests/fixtures/retrieval_quality/skills/codex-builtins/community-evals commit e9257a9fb2

Frequently asked questions

npx skillmds@latest add rycen7822/huggingface-community-evals