Local Inference Tuning

Select and tune a local LLM inference engine for the user's hardware. Use when setting up or auditing local/private model serving, choosing between MLX, llama.cpp, Ollama, and vLLM, estimating model fit, deciding cache/storage policy, tuning batching and KV cache flags, running smoke benchmarks, or exposing an OpenAI-compatible local endpoint.

markoblogo Updated 16 repo stars
LoopOps promotion ladder from prompt to checklist, skill, script, or bounded loop

File contents

markoblogo/abvx-agent-skills commit 914d385df1

Frequently asked questions

npx get-skill add markoblogo/local-inference-tuning