Paddle Design Distributed

Use when working with Paddle's distributed training system: understanding parallelism strategies (DP, ZeRO, TP, PP, SP), semi-automatic parallel with ProcessMesh + shard_tensor, SPMD inference rules, pipeline scheduling, or auto_parallel Engine.

PaddlePaddle Updated

File contents

paddlepaddle/paddle commit 0e0ea67620

Frequently asked questions

npx get-skill add paddlepaddle/paddle-design-distributed