Dppo Divergence Policy

Replace PPO's heuristic ratio-based clipping with Divergence Proximal Policy Optimization (DPPO) that directly constrains policy divergence using either Total Variation or KL, enabling lightweight approximations (Binary, Top-K) for vocabulary-scale computations while improving stability and efficiency.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit 7698dc05d5

Frequently asked questions

npx get-skill add adu2021/dppo-divergence-policy