Hover Eval

Probes a model's ability to perform many-hop fact verification by retrieving supporting evidence from multiple Wikipedia articles and determining whether a given claim is supported or not supported. It specifically tests long-range dependency reasoning, coreference resolution, and the ability to avoid semantic matching shortcuts that degrade as hop count increases. Use when the user wants to benchmark on HOVER, or asks about evaluating this task. Reports claim verification accuracy.

qhjqhj00 Updated 3 repo stars

File contents

qhjqhj00/research-skills-pool commit d9eb9850a1

Frequently asked questions

npx get-skill add qhjqhj00/hover-eval