Kv Cache Quantization

Compresion de KV Cache FP16 a Int8/FP8 para duplicar contexto.

belentani7 Updated

File contents

kv-cache-quantization

Compresion de KV Cache FP16 a Int8/FP8 para duplicar contexto.

Usage

Invoke this skill when the task matches: compresion de kv cache fp16 a int8/fp8 para duplicar contexto..

Commands

  • npx skills add belentani/kv-cache-quantization - install this skill

Related Skills

  • ollama-orchestration
  • qwen-coder-tuning
  • audio-dsp-analysis

belentani7/agent-skills/tree/main/skills/kv-cache-quantization commit 91a7d4b5d9

Frequently asked questions

npx skillmds@latest add belentani7/kv-cache-quantization