Prefix Grouper Grpo

Implement Prefix Grouper to accelerate Group Relative Policy Optimization training by eliminating redundant prefix encoding, achieving up to 8x speedup for long-context scenarios.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit e9e05463bf

Frequently asked questions

npx get-skill add adu2021/prefix-grouper-grpo