Efficient Dlm Ar Conversion

Systematically convert pretrained autoregressive models into efficient diffusion language models via block-wise attention and position-dependent masking. Efficient-DLM family (1.5B/4B/8B) maintains comparable accuracy to standard AR models while delivering 4.5× higher throughput.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit 34288e2d52

Frequently asked questions

npx get-skill add adu2021/efficient-dlm-ar-conversion