Covrl Variational Reasoning

Enhance language model reasoning through coupled sampling from prior (question-only) and posterior (answer-conditioned) distributions. Construct composite distribution mixing both at token level using hybrid sampling. Combine reconstruction term, selective NLL loss, and KL regularization. Achieve 12.4% improvement over base model and 2.3% over comparable baselines.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit a4729ddb0a

Frequently asked questions

npx get-skill add adu2021/covrl-variational-reasoning