Bottom Up Policy

Optimize language model policies layer-by-layer rather than monolithically to understand internal reasoning structure. Decompose models into per-layer and per-module policies via residual streams, analyze entropy patterns revealing exploration→convergence phases, and optimize layers sequentially—improving reasoning on math tasks by up to 4.69 points.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit 2fa57c72fb

Frequently asked questions

npx get-skill add adu2021/bottom-up-policy