Gguf

GGUF format and llama.cpp quantization for efficient CPU/GPU inference. Use when deploying models on consumer hardware, Apple Silicon, or when needing flexible quantization from 2-8 bit without GPU requirements.

graniet Updated 213 repo stars

File contents

graniet/kheish commit 70d1e9d472

Frequently asked questions

npx get-skill add graniet/gguf