Results for “scoring”
9 skillsinfolm
Computes the InfoLM metric from torchmetrics for evaluating text generation against ground truth, with configurable information measures and sentence-level scoring.
3
rna
Annotates single-cell RNA-seq data by scoring marker genes, transferring labels with CellTypist, or reasoning over marker lists with an LLM.
567 · bundle
art-eval
Benchmarks medical AI agents on synthetic EHR tasks, measuring success rates for data retrieval, temporal aggregation, and threshold-based conditional logic with exact-match scoring.
3
More results
cab-eval
Benchmarks LLM bias by scoring responses to automatically generated open-ended questions across sensitive attributes, producing a composite fitness score from 0 to 5.
3
universal-single-cell-annotator
Annotates single-cell RNA-seq data by scoring marker genes, transferring labels with CellTypist, or reasoning over cluster markers with an LLM.
567 · bundle
f1score
Compute the F1Score metric using torchmetrics when predictions and ground-truth labels are available.
3
aya-eval
Evaluates open-ended generation quality of multilingual LLMs across brainstorming, planning, and long-form tasks, using AYA and DOLLY datasets with qualitative fluency and quality scoring.
3
bis-eval
Benchmarks energy-function-based safe control algorithms on the BIS (Benchmark of Interactive Safety) dataset, scoring safety, efficiency, and hybrid performance in human-robot and robot co-working scenarios.
3
tao-analyze-gaps-visual-changenet
Identifies the weakest samples per ground-truth label in NVIDIA TAO VCN Classify experiments by running a Docker container that performs threshold sweep, weakness scoring, and per-lighting expansion, then surfaces top-K weak samples for downstream augmentation or relabeling.
2.2k · bundle