Discreteness Diffusion LLM

Understand fundamental limitations of applying diffusion to discrete text: position-agnostic corruption ignores linguistic structure, and token-wise training misses multi-token dependencies. Design text diffusion systems satisfying five essential properties: position-aware corruption, dependency-aware training, parallel consistency, linguistic structure respecting, and robust handling of token boundaries.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit d67ab6247c

Frequently asked questions

npx get-skill add adu2021/discreteness-diffusion-llm