Rewardmap Sparse Rewards Visual Reasoning

Improve multimodal LLMs on fine-grained visual reasoning tasks (e.g., reading transit maps) by decomposing training into stages: basic perception (VQA) -> simple reasoning -> complex spatial reasoning. Incorporates 'detail rewards' for intermediate visual understanding, bootstrapping models from simple to complex tasks while addressing sparse reward challenges.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit 6627692157

Frequently asked questions

npx get-skill add adu2021/rewardmap-sparse-rewards-visual-reasoning