Huggingface Local Models

Use to select models to run locally with llama.cpp and GGUF on CPU, Mac Metal, CUDA, or ROCm. Covers finding GGUFs, quant selection, running servers, exact GGUF file lookup, conversion, and OpenAI-compatible local serving.

Hugging Face Updated 11.4k repo stars
ML Claw

File contents

huggingface/mlclaw commit ece849559d

Frequently asked questions

npx get-skill add huggingface/huggingface-local-models-2