SkillMD SkillMD
light-dark-mode
Profile My skills Saved Collections Edit profile Submit a skill

Results for “vllm”

3 skills
google
Gke Inference
Deploys and optimizes AI/ML inference workloads on GKE, using GPUs, TPUs, and model servers.
14.4k
More results
huggingface
Hf Cloud Sagemaker Production Defaults
Creates SageMaker endpoints (real-time or async) with autoscaling, CloudWatch alarms, and tagging enabled by default, then smoke-tests them before declaring success.
10.8k · bundle
huggingface
Hf Cloud Serving Image Selection
Selects the correct SageMaker serving container image URI for HuggingFace model deployments, prioritizing HuggingFace-curated Deep Learning Containers over generic alternatives.
10.8k · bundle