Nano Vllm

Use this skill when the user wants to use nano vllm — minimal vllm implementation with paged and flash attention.

javimosch Updated 57 repo stars

File contents

Nano-Vllm Plugin

Nano vLLM — minimal vLLM implementation with paged and flash attention

Commands

  • nano-vllm _ _ — Passthrough to nano-vllm CLI

Installation

pip install nano-vllm

Examples

nano-vllm --help
nano-vllm --version

javimosch/supercli commit e9754cea43

Frequently asked questions

npx get-skill add javimosch/nano-vllm