Mixed Precision Deployment

Ship FP16, BF16, or FP8 training and inference that holds accuracy while capturing the speedup, using loss scaling and numeric validation. Use when moving a model off FP32 to run faster or fit in less memory and the result must stay correct.

Amey-Thakur Updated 14 repo stars

File contents

Amey-Thakur/AI-SKILLS commit c6347463f1

Frequently asked questions

npx get-skill add amey-thakur/mixed-precision-deployment