Results for “metric-command”
6 skillsNemo Evaluator Plugin
Run evaluation tasks against a NeMo Platform server using the Evaluator plugin CLI and Python SDK.
2.2k · bundle
Recall
Computes the Recall metric using torchmetrics, including configuration for binary, multiclass, and multilabel tasks.
3
Ml Engineering
Enforces rigorous ML modeling, feature engineering, training, and evaluation standards at principal-engineer level.
0
Squad
Computes the SQuAD metric using torchmetrics, given predictions and ground truth. Use when evaluating question-answering outputs with exact match and F1 scores.
3
Roc
Computes the Receiver Operating Characteristic (ROC) metric using torchmetrics, supporting binary, multiclass, and multilabel tasks.
3
Auroc
Computes the AUROC metric using torchmetrics, handling binary, multiclass, and multilabel tasks with configurable thresholds and averaging.
3