Minicpm5 Deploy Llama Cpp

Run MiniCPM5-1B or MiniCPM5-2B with llama.cpp using the released GGUF artifacts (F16 / Q8_0 / Q4_K_M). Use when the user wants CPU-only / consumer-GPU / cross-platform native deployment, asks for "llama.cpp", "llama-cli", "llama-server", "GGUF", or has no Python available.

OpenBMB Updated 11.9k repo stars
MiniCPM5-2B capability comparison by domain

File contents

openbmb/minicpm commit fea681a556

Frequently asked questions

npx get-skill add openbmb/minicpm5-deploy-llama-cpp