Local LLM Serving

Set up, launch, and verify a self-hosted local LLM serving stack (controller + web UI + llama.cpp backend) on macOS/Linux. Covers model downloads, recipe creation, CPU-only inference, OpenAI-compatible proxy verification, and usage accounting.

theheavenlyd3mon Updated 60 repo stars

File contents

theheavenlyd3mon/hermes-profiles commit 18243118c9

Frequently asked questions

npx get-skill add theheavenlyd3mon/local-llm-serving