Hqq Fast Kernel Weight Quantization

Half-Quadratic Quantization for LLMs without calibration data. Use when quantizing models to 4/3/2-bit precision without needing calibration datasets, for fast quantization workflows, or when deploying with vLLM or HuggingFace Transformers.

robertoatila Updated 9 repo stars
J.A.R.V.I.S. — Autonomous Cognitive Runtime

File contents

robertoatila/jarvis-skill-registry commit a621258a07

Frequently asked questions

npx get-skill add robertoatila/hqq-fast-kernel-weight-quantization-2