Spatial Ssrl Spatial Understanding Rl

Improve spatial reasoning in vision-language models through five automatically-formulated pretext tasks (patch shuffling, flipping, inpainting, depth ordering, 3D position) that require zero human annotation, using only RGB/RGB-D images and RL optimization for 4% accuracy gains.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit 4ebd2bb5f3

Frequently asked questions

npx get-skill add adu2021/spatial-ssrl-spatial-understanding-rl