Canvit Active Vision Foundation Model

Establishes Active-Vision Foundation Models (AVFM) as a new problem class and proposes CanViT: a retinotopic ViT backbone with Canvas Attention that decouples thinking (glimpse processing) from memory (scene canvas). Dense latent distillation from DINOv3 enables unsupervised pretraining on 1B random glimpses. Achieves 81.2% ImageNet accuracy with frozen probes—proving foundation models can be adapted to active-vision tasks. Trigger: When building systems requiring selective visual attention to scenes (robotics, surveillance, embodied AI), apply the active-vision paradigm with retinotopic architecture and canvas memory to scale beyond single-glimpse models.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit 2f9919e350

Frequently asked questions

npx get-skill add adu2021/canvit-active-vision-foundation-model