Tensorrt

NVIDIA TensorRT — deep learning inference optimizer. FP16/INT8/INT4 quantization, kernel auto-tuning, layer fusion, and dynamic shapes. Max throughput on NVIDIA GPUs for production inference.

mkurman Updated 327 repo stars
Picture from the README

File contents

mkurman/zorai commit d9121b17d0

Frequently asked questions

npx get-skill add mkurman/tensorrt