Emergent Temporal Abstraction

Discover hierarchical temporal abstractions within autoregressive models via internal RL, enabling efficient exploration of sparse-reward tasks. Metacontroller learns abstract action sequences modifying residual streams, switching gates enable quasi-binary patterns, and abstract-space RL achieves many orders-of-magnitude speedup over token-level learning.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit 046e354653

Frequently asked questions

npx get-skill add adu2021/emergent-temporal-abstraction