Model Integration

Guide for integrating a new model into the Relax training pipeline. Use when adding a new model architecture, writing Megatron-to-HF weight converters, implementing custom TP all-gather/chunk logic, debugging weight sync issues, or adapting models for colocate or fully-async mode. Covers Megatron backend (bridge and raw modes) and FSDP backend.

redai-infra Updated 676 repo stars

File contents

redai-infra/relax commit ea69e6f514

Frequently asked questions

npx get-skill add redai-infra/model-integration