Triton Pytorch Model Repository

Deploy a user's PyTorch model as a working Triton Inference Server endpoint, end to end. Use when the user has a TorchScript .pt file or a PT2 archive (.pt2 from torch.export + AOT Inductor) and wants it served, wants a config.pbtxt written from scratch, or wants to debug a Triton load or inference failure on a PyTorch model. Use triton-onnx-model-repository for .onnx files and triton-tensorrt-model-repository for .plan engines.

NVIDIA Updated 23k repo stars

File contents

NVIDIA/skills commit 71c8d1e45d

Frequently asked questions

npx get-skill add nvidia/triton-pytorch-model-repository