Thinkjepa Dual Temporal World Model

Replace single-pathway JEPA with a dual-temporal architecture combining dense frame sampling (fine-grained dynamics) and uniformly-sampled VLM guidance (semantic coherence) to improve egocentric trajectory prediction by 14-27% on ADE/accuracy metrics. Effective when predicting hand-object interactions where both low-level dynamics and high-level semantic context matter, and long-horizon predictions benefit from hierarchical visual representations.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit 2bd4b7fb54

Frequently asked questions

npx get-skill add adu2021/thinkjepa-dual-temporal-world-model