Checkpointing Large Training

Checkpoint multi-node training runs so a save costs seconds instead of minutes and a resume reproduces the run exactly. Use when a job is large enough that a crash without a recent, verified checkpoint means losing hours of GPU time.

Amey-Thakur Updated 14 repo stars

File contents

Amey-Thakur/AI-SKILLS commit bcf6eaf0d2

Frequently asked questions

npx get-skill add amey-thakur/checkpointing-large-training