Turn Ppo

Stabilize multi-turn agent RL by shifting from token-level to turn-level MDPs. Reformulates states and actions at conversation-turn granularity, uses learned turn-level critics, and applies Generalized Advantage Estimation—eliminating misalignment that destabilizes GRPO training on long-horizon agentic tasks.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit 86855fd300

Frequently asked questions

npx get-skill add adu2021/turn-ppo