Results for “community-metrics”
2 skillsbbq-eval
Evaluates social bias in question-answering models using the BBQ benchmark, measuring accuracy and a bias score across ambiguous and disambiguated contexts to reveal reliance on stereotypes.
3
recall
Computes the Recall metric using torchmetrics, including configuration for binary, multiclass, and multilabel tasks.
3