Results for “rubric-scoring”
5 skillsAuroc
Computes the AUROC metric using torchmetrics, handling binary, multiclass, and multilabel tasks with configurable thresholds and averaging.
3
Roc
Computes the Receiver Operating Characteristic (ROC) metric using torchmetrics, supporting binary, multiclass, and multilabel tasks.
3
Logauc
Computes the LogAUC metric using the torchmetrics implementation for binary, multiclass, or multilabel classification tasks.
3
F1score
Compute the F1Score metric using torchmetrics when predictions and ground-truth labels are available.
3
Accuracy
Evaluates an AI judge system's pairwise ranking accuracy on generated commit messages against a heuristic ground truth from five automatic text metrics, using the MCMD dataset.
3