Perception Aware Policy Optimization

Optimize multimodal LLMs by directly targeting perception errors using KL-divergence based perception loss, improving visual reasoning by 8-19% on vision-dependent tasks. Integrates perception-aware signals into policy gradients without relying solely on reward modifications.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit 0004fb1b2d

Frequently asked questions

npx get-skill add adu2021/perception-aware-policy-optimization