Hqq Quantization

Half-Quadratic Quantization for LLMs without calibration data. Use when quantizing models to 4/3/2-bit precision without needing calibration datasets, for fast quantization workflows, or when deploying with vLLM or HuggingFace Transformers.

synthetic-sciences Updated 4.4k repo stars
An OpenScience session comparing EGFR inhibitor potency: the trace shows the search, the written files, the analysis run and the answer with a results table

File contents

synthetic-sciences/openscience commit 3900aae957

Frequently asked questions

npx get-skill add synthetic-sciences/hqq-quantization