Slow Fast Policy Optimization Rl

Stabilize RL for LLM reasoning via three-phase decomposition: fast inner trajectory optimization, repositioning to manage off-policy drift, slow correction for stable updates. Achieve up to 2.80-point math reasoning gains over GRPO while reducing rollouts 4.93x and wall-clock time 4.19x via improved stability without changing reward structure.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit 2cea39e4eb

Frequently asked questions

npx get-skill add adu2021/slow-fast-policy-optimization-rl