Llama Cpp 1 0 0

C/C++ LLM inference library with GGUF support, quantization, GPU acceleration (CUDA/Metal/HIP/Vulkan/SYCL), OpenAI-compatible server, and speculative decoding. Use when building local LLM inference applications, deploying models on edge devices, creating OpenAI-compatible API servers, or working with GGUF models.

tangledgroup Updated 1 repo stars

File contents

tangledgroup/tangled-skills commit ebe55c788f

Frequently asked questions

npx get-skill add tangledgroup/llama-cpp-1-0-0