Llamacpp Docs

llama.cpp Documentation

Official llama.cpp docs (sourced from github.com/ggml-org/llama.cpp/docs).

CRITICAL: grep references/ for keywords before answering.

Topic Index

Build & Install

• build.md — Building from source (CMake)
• install.md — Installation guide
• docker.md — Docker setup
• android.md — Android deployment
• build-riscv64-spacemit.md — RISC-V 64-bit build
• build-s390x.md — s390x architecture build

Features

• function-calling.md — Function calling / tool use
• speculative.md — Speculative decoding
• multimodal.md — Multimodal model support (overview)
• preset.md — Preset configurations
• llguidance.md — LLGuidance grammar integration
• autoparser.md — Auto-parser for structured output
• ops.md — Supported operations reference

GPU Backends

• backend/CUDA-FEDORA.md — CUDA on Fedora
• backend/SYCL.md — Intel SYCL backend
• backend/OPENCL.md — OpenCL backend
• backend/BLIS.md — BLIS backend
• backend/CANN.md — Huawei Ascend CANN backend
• backend/VirtGPU.md — Virtual GPU backend
• backend/VirtGPU/ — VirtGPU configuration & development
• backend/ZenDNN.md — AMD ZenDNN backend
• backend/zDNN.md — IBM zDNN backend
• backend/snapdragon/ — Qualcomm Snapdragon NPU

Multimodal Models

• multimodal/llava.md — LLaVA vision-language model
• multimodal/gemma3.md — Gemma 3 multimodal
• multimodal/glmedge.md — GLM Edge model
• multimodal/granitevision.md — Granite Vision
• multimodal/MobileVLM.md — Mobile VLM
• multimodal/minicpm*.md — MiniCPM series (v2.5, v2.6, v4.0, v4.5, o2.6, o4.0)

Development

• development/HOWTO-add-model.md — Adding new model architectures
• development/token_generation_performance_tips.md — Performance optimization
• development/debugging-tests.md — Debugging tests
• development/parsing.md — Parsing internals