Minicpm5 Deploy Vllm Ascend

Deploy MiniCPM5-2B with vLLM on Huawei Ascend NPU using vLLM-Ascend. Use when the user mentions vLLM-Ascend, Ascend NPU, Huawei Ascend, CANN, torch_npu, davinci devices, or wants an OpenAI-compatible MiniCPM5 server on Ascend hardware.

OpenBMB Updated 11.9k repo stars
MiniCPM5-2B capability comparison by domain

File contents

openbmb/minicpm commit d3f45a4861

Frequently asked questions

npx get-skill add openbmb/minicpm5-deploy-vllm-ascend