Profile My skills Saved Collections Edit profile Submit a skill

Hage2000 Code Eval Stdio

Compute hage2000/code_eval_stdio via the HuggingFace `evaluate` library. Use when the user has predictions + references and wants the canonical implementation of hage2000/code_eval_stdio.

qhjqhj00 f6d468b 870 B Updated 3 repo stars
AI & ML

File contents

hage2000-code-eval-stdio

Metric hage2000/code_eval_stdio from the HuggingFace evaluate library.

When to invoke

User asks to compute hage2000/code_eval_stdio or wants HF evaluate's canonical version.

Recipe

import evaluate
metric = evaluate.load("hage2000/code_eval_stdio")
result = metric.compute(predictions=preds, references=refs)
print(result)

Don'ts

  • Don't assume your in-house hage2000/code_eval_stdio matches HF — version conventions vary.
  • Many evaluate metrics have task-specific arguments (average=, lang=, model_type=); read the metric card before reporting numbers.

qhjqhj00/research-skills-pool/tree/main/skill-factory/output/hage2000-code-eval-stdio commit f6d468b36c

Browse category

Frequently asked questions

npx skillmds add qhjqhj00/hage2000-code-eval-stdio