Minicpm5 Deploy Vllm

Serve MiniCPM5-1B or MiniCPM5-2B via vLLM as an OpenAI-compatible HTTP server. Use when the user wants high-throughput production serving on NVIDIA GPU, asks for "vLLM", "OpenAI server", "REST API for MiniCPM5", or "production deployment".

OpenBMB Updated 11.9k repo stars
MiniCPM5-2B capability comparison by domain

File contents

openbmb/minicpm commit faa1562ca8

Frequently asked questions

npx get-skill add openbmb/minicpm5-deploy-vllm