Results for “task-arithmetic”
7 skills
More results
qhjqhj00 arc-eval
Benchmarks systems on the Abstraction and Reasoning Corpus (ARC) by requiring inference of abstract transformation rules from few input-output grid demonstrations and application to novel test cases, reporting the fraction of tasks solved.
3
qhjqhj00 recall
Computes the Recall metric using torchmetrics, including configuration for binary, multiclass, and multilabel tasks.
3
qhjqhj00 auroc
Computes the AUROC metric using torchmetrics, handling binary, multiclass, and multilabel tasks with configurable thresholds and averaging.
3
qhjqhj00 tec
Measures the trade-off between computation time and energy consumption in mobile edge computing by computing a weighted sum of the two objectives, given system configuration parameters and per-user task characteristics.
3
qhjqhj00 squad
Computes the SQuAD metric using torchmetrics, given predictions and ground truth. Use when evaluating question-answering outputs with exact match and F1 scores.
3
qhjqhj00 tctb
Evaluates the throughput and resource allocation efficiency of RIS-aided mobile edge computing systems by measuring the total computation task bits successfully completed under varying network conditions.
3