Evolution Strategies LLM Finetuning

Scale Evolution Strategies to billion-parameter LLMs without backpropagation for superior robustness and stability across diverse models, reward horizons, and evaluation tasks. Outperforms RL methods while eliminating gradient computation overhead.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit 035f42c491

Frequently asked questions

npx get-skill add adu2021/evolution-strategies-llm-finetuning