How do I install the Coreweave Reference Architecture skill?

Run npx skillmds@latest add jeremylongshore/coreweave-reference-architecture in your terminal (requires Node.js), paste this page's agent-chat prompt into Claude, Cursor, or any MCP-connected agent, or download the SKILL.md file and copy it into your agent's skills directory.

Is Coreweave Reference Architecture safe to use?

This skill has not completed SkillMD's automated safety review yet. Capability flags: makes network calls. SkillMD never runs a skill's scripts for you; review the SKILL.md before installing.

Which AI agents work with Coreweave Reference Architecture?

This skill is tagged as working with Claude Code, Claude.ai, OpenAI Codex. SKILL.md is an open format, so most agents that read a skills directory can load it too.

Is Coreweave Reference Architecture free to use?

Yes. Installing skills from SkillMD is free. This skill is licensed under MIT.

Who published Coreweave Reference Architecture?

jeremylongshore (@jeremylongshore) published this skill. Their other Agent Skills are listed on their SkillMD profile.

Coreweave Reference Architecture by jeremylongshore

Name: Coreweave Reference Architecture
Rating: 4.2 (5 reviews)
Author: jeremylongshore

Coreweave Reference Architecture

Reference architecture for CoreWeave GPU cloud deployments. Use when designing ML infrastructure, planning multi-model serving, or establishing CoreWeave deployment standards. Trigger with phrases like "coreweave architecture", "coreweave design", "coreweave infrastructure", "coreweave best practices".

File contents

CoreWeave Reference Architecture

Architecture Diagram

                    ┌─────────────────────┐
                    │   Load Balancer     │
                    │   (Ingress/LB)      │
                    └──────────┬──────────┘
                               │
              ┌────────────────┼────────────────┐
              │                │                │
     ┌────────▼──────┐ ┌──────▼────────┐ ┌─────▼───────┐
     │ Model A       │ │ Model B       │ │ Model C     │
     │ (vLLM, A100)  │ │ (TGI, H100)  │ │ (SD, L40)   │
     │ 2 replicas    │ │ 1 replica     │ │ 3 replicas  │
     └───────────────┘ └───────────────┘ └─────────────┘
              │                │                │
     ┌────────▼────────────────▼────────────────▼───────┐
     │              Shared Storage (PVC)                │
     │         Models / Checkpoints / Data              │
     └──────────────────────────────────────────────────┘

Project Structure

ml-platform/
├── k8s/
│   ├── base/                    # Shared templates
│   ├── models/
│   │   ├── llama-8b/           # Per-model manifests
│   │   ├── llama-70b/
│   │   └── stable-diffusion/
│   └── infra/
│       ├── storage.yaml         # PVCs
│       ├── secrets.yaml         # Model tokens
│       └── monitoring.yaml      # Prometheus rules
├── containers/
│   ├── vllm/Dockerfile
│   └── custom-server/Dockerfile
├── scripts/
│   ├── deploy.sh
│   └── benchmark.sh
└── monitoring/
    ├── grafana-dashboards/
    └── alert-rules.yaml

Key Design Decisions

Decision	Choice	Rationale
Serving framework	vLLM	Continuous batching, PagedAttention
GPU type (production)	A100 80GB	Best price/performance for inference
Storage	Shared PVC (SSD)	Fast model loading across replicas
Autoscaling	KServe + Knative	Native scale-to-zero support
Container registry	GHCR	GitHub integration, free for public

Resources

Next Steps

For multi-environment setup, see coreweave-multi-env-setup.

---name: coreweave-reference-architecturedescription: Reference architecture for CoreWeave GPU cloud deployments. Use when designing ML infrastructure, planning multi-model serving, or establishing CoreWeave deployment standards. Trigger with phrases like "coreweave architecture", "coreweave design", "coreweave infrastructure", "coreweave best practices".license: MIT---# CoreWeave Reference Architecture## Architecture Diagram``` ┌─────────────────────┐ │ Load Balancer │ │ (Ingress/LB) │ └──────────┬──────────┘ │ ┌────────────────┼────────────────┐ │ │ │ ┌────────▼──────┐ ┌──────▼────────┐ ┌─────▼───────┐ │ Model A │ │ Model B │ │ Model C │ │ (vLLM, A100) │ │ (TGI, H100) │ │ (SD, L40) │ │ 2 replicas │ │ 1 replica │ │ 3 replicas │ └───────────────┘ └───────────────┘ └─────────────┘ │ │ │ ┌────────▼────────────────▼────────────────▼───────┐ │ Shared Storage (PVC) │ │ Models / Checkpoints / Data │ └──────────────────────────────────────────────────┘```## Project Structure```ml-platform/├── k8s/│ ├── base/ # Shared templates│ ├── models/│ │ ├── llama-8b/ # Per-model manifests│ │ ├── llama-70b/│ │ └── stable-diffusion/│ └── infra/│ ├── storage.yaml # PVCs│ ├── secrets.yaml # Model tokens│ └── monitoring.yaml # Prometheus rules├── containers/│ ├── vllm/Dockerfile│ └── custom-server/Dockerfile├── scripts/│ ├── deploy.sh│ └── benchmark.sh└── monitoring/ ├── grafana-dashboards/ └── alert-rules.yaml```## Key Design Decisions| Decision | Choice | Rationale ||----------|--------|-----------|| Serving framework | vLLM | Continuous batching, PagedAttention || GPU type (production) | A100 80GB | Best price/performance for inference || Storage | Shared PVC (SSD) | Fast model loading across replicas || Autoscaling | KServe + Knative | Native scale-to-zero support || Container registry | GHCR | GitHub integration, free for public |## Resources- [CoreWeave Documentation](https://docs.coreweave.com)- [CoreWeave Examples](https://github.com/coreweave/kubernetes-cloud)## Next StepsFor multi-environment setup, see `coreweave-multi-env-setup`.

Frequently asked questions