Add Inference Backend

Add a new hardware inference backend to AutoRound for deploying quantized models (e.g., CUDA/Marlin, Triton, CPU, HPU, ARK). Use when implementing QuantLinear kernels, registering backend capabilities, or enabling quantized model inference on a new hardware platform.

intel Updated 122 repo stars
AutoRound Overview

File contents

intel/auto-round commit 426de37ef5

Frequently asked questions

npx get-skill add intel/add-inference-backend