Huggingface Local Models

Use to select models to run locally with llama.cpp and GGUF on CPU, Mac Metal, CUDA, or ROCm. Covers finding GGUFs, quant selection, running servers, exact GGUF file lookup, conversion, and OpenAI-compatible local serving.

mouadja02 Updated 13 repo stars

File contents

mouadja02/skills commit cc7f275ca9

Frequently asked questions

npx get-skill add mouadja02/huggingface-local-models