Tdbench Eval

Evaluates vision-language models on top-down (aerial) image understanding by testing their ability to answer questions about rotated views. It measures rotational consistency to filter out hallucinations and decomposes performance into true knowledge versus lucky guessing via a probabilistic reliability framework. Use when the user wants to benchmark on TDBench, or asks about evaluating this task. Reports RotationalEval (RE).

qhjqhj00 Updated 3 repo stars

File contents

qhjqhj00/research-skills-pool commit 95b36171d7

Frequently asked questions

npx get-skill add qhjqhj00/tdbench-eval