Gguf Quantization

GGUF format and llama.cpp quantization for efficient CPU/GPU inference. Use when deploying models on consumer hardware, Apple Silicon, or when needing flexible quantization from 2-8 bit without GPU requirements.

math-inc Updated

File contents

math-inc/opengauss commit 80bfa709e1

Frequently asked questions

npx get-skill add math-inc/gguf-quantization