Plugins

1 plugin

Fine-Tune Transformer Model

Fine-tune transformer language models using TRL with support for SFT, DPO, GRPO, and reward model training.

8 skills · plugin

Results for “training”

4 skills

tao-run-platform

Submit and monitor GPU training jobs on Brev, SLURM, Docker, or Kubernetes using the TAO Execution SDK, with job handles, S3 I/O wrapping, and multi-node distributed training.

orchestra-research

openrlhf-training

Train large language models (7B-70B+) with RLHF using PPO, GRPO, DPO, and other algorithms, accelerated by Ray and vLLM for distributed multi-GPU setups.

10.4k · bundle

More results

tao-run-on-slurm

Submit and manage TAO training, evaluation, and inference jobs on SLURM GPU clusters over SSH with sbatch/srun, Pyxis/Enroot containers, and Lustre-backed storage.

nemo-mbridge-multi-node-slurm

Convert single-node PyTorch distributed scripts into multi-node Slurm sbatch jobs and debug common multi-node failures, covering srun-native and torch.distributed approaches, container setup, NCCL timeouts, and interactive allocation.