Openrlhf Ray Distributed Reinforcement Learning

High-performance RLHF framework with Ray+vLLM acceleration. Use for PPO, GRPO, RLOO, DPO training of large models (7B-70B+). Built on Ray, vLLM, ZeRO-3. 2× faster than DeepSpeedChat with distributed architecture and GPU resource sharing.

robertoatila Updated 9 repo stars
J.A.R.V.I.S. — Autonomous Cognitive Runtime

File contents

robertoatila/jarvis-skill-registry commit 6cb1b4e5d9

Frequently asked questions

npx get-skill add robertoatila/openrlhf-ray-distributed-reinforcement-learning-2