Calm Continuous Autoregressive Language Models

Replace discrete token prediction with continuous vector prediction by training a high-fidelity autoencoder to compress K tokens into single latent vectors, enabling K-fold sequence length reduction while maintaining likelihood-free generation through energy-based scoring rules.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit cf099bde97

Frequently asked questions

npx get-skill add adu2021/calm-continuous-autoregressive-language-models