AI Inference Optimization

Expert guidance on optimizing LLM inference with Red Hat AI Inference Server, vLLM, LLM Compressor, quantization strategies (W8A8, AWQ, sparsity), and multi-accelerator deployment for production cost efficiency

pramodmax Updated

File contents

pramodmax/openshift-ai-skills commit 720995e4a9

Frequently asked questions

npx get-skill add pramodmax/ai-inference-optimization