Reinforce Ada Adaptive Sampling Rl Llms

Recover learning signals in RL for LLM reasoning by dynamically allocating sampling budget based on prompt difficulty. Use log-objective weighting (1/p for pass rate p) to prioritize challenging examples, achieving 2x convergence speedup versus uniform sampling while maintaining identical compute budgets across math, coding, and general benchmarks.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit 7847cedf53

Frequently asked questions

npx get-skill add adu2021/reinforce-ada-adaptive-sampling-rl-llms