Two Grpo Contrastive Efficiency

Reduce GRPO training cost by 87.5% using only 2 rollouts instead of 16 while achieving 98.1% of baseline performance. Leverage the insight that GRPO's group mechanism serves contrastive learning rather than advantage estimation.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit 2a6df1e2de

Frequently asked questions

npx get-skill add adu2021/two-grpo-contrastive-efficiency