Profile My skills Saved Collections Edit profile Submit a skill

← all publishers

vllm-project

@vllm-project-llm-compressor source repo

)}

3 published skills

  1. ▌
    Nvfp4 · vllm-project-llm-compressor
    Generate a working NVFP4 (W4A4) quantization example script and save a compressed-tensors checkpoint. Triggers on: "nvfp4", "NVFP4", "fp4", "nvfp4 example", "quantize to nvfp4", "w4a4".
    0
    installs
  2. ▌
    Create Tiny Model · vllm-project-llm-compressor bundle
    Create and manage tiny models for testing and development. Includes utilities for saving tiny models, inspecting tensors, and finetuning workflows.
    0
    installs
  3. ▌
    Fp8 · vllm-project-llm-compressor bundle
    Generate a working FP8 quantization example script and save a compressed-tensors checkpoint. Triggers on: "fp8", "FP8_DYNAMIC", "FP8_BLOCK", "MXFP8", "fp8 example", "quantize to fp8".
    0
    installs