Results for “mitmproxy”

Configure fault tolerance, straggler detection, preemption, in-process restart, and re-run state machine for Megatron Bridge training jobs.

Validate and configure packed sequences and long-context training in Megatron-Bridge, distinguishing offline packed SFT for LLMs from in-batch packing for VLMs with correct context parallelism constraints.

Trains LLMs with SimPO, a reference-free preference optimization method that outperforms DPO, using configurable hyperparameters and workflows for various models and tasks.