Attnrl Attention Compass Reasoning Exploration

Guide LLM exploration in reasoning tasks using attention patterns as navigation signals. This technique branches exploration from high-attention tokens (likely reasoning steps) and applies adaptive sampling to maintain effective gradients, significantly improving training efficiency for mathematical reasoning.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit 28c887efeb

Frequently asked questions

npx get-skill add adu2021/attnrl-attention-compass-reasoning-exploration