jzm-mailchimp-joshs-second-test-metric
Metric
jzm-mailchimp/joshs_second_test_metricfrom the HuggingFaceevaluatelibrary.
When to invoke
User asks to compute jzm-mailchimp/joshs_second_test_metric or wants HF evaluate's canonical version.
Recipe
import evaluate
metric = evaluate.load("jzm-mailchimp/joshs_second_test_metric")
result = metric.compute(predictions=preds, references=refs)
print(result)
Don'ts
- Don't assume your in-house
jzm-mailchimp/joshs_second_test_metricmatches HF — version conventions vary. - Many evaluate metrics have task-specific arguments (
average=,lang=,model_type=); read the metric card before reporting numbers.