Looped Elastic Depth Transformers

Enable budget-conditioned reasoning by repeatedly applying a shared transformer block stack with trajectory-based conditioning on time and step size. Train via shortcut-consistency loss to align shorter and full-length trajectories, enabling variable-depth inference without retraining.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit 398ad3fa8c

Frequently asked questions

npx get-skill add adu2021/looped-elastic-depth-transformers