Results for “unigram-f1”

4 skills

Evaluates the faithfulness of abstractive summaries by verifying if factual claims (masked as cloze questions) in the reference summary can be correctly answered using only the generated summary, compared against a gold-standard answer derived from the source context.

More results

Compute the F1Score metric using torchmetrics when predictions and ground-truth labels are available.

Estimates memory requirements for running Hugging Face models, including optional KV cache, using HTTP range requests without downloading weights.

orchestra-research

Huggingface Accelerate

Add distributed training support to any PyTorch script with minimal code changes using a unified API for DDP, DeepSpeed, FSDP, and mixed precision.

10.4k · bundle