Llama Cpp

Run GGUF models locally with llama.cpp, including finding the right file on the Hugging Face Hub, installing, quantizing, serving, and using Python bindings.

infinition Updated 35 repo stars
LaRuche

File contents

infinition/LaRuche commit 33bc6f0c8f

Frequently asked questions

npx get-skill add infinition/llama-cpp