Genai Factory Serve Private Models

Use when deploying or configuring the genai-factory serve-private-models blueprint (Vertex AI Model Garden open models such as Gemma 3 privately exposed via Private Service Connect to a Cloud Run frontend with Load Balancer, Cloud Armor, and Model Armor), configuring model_garden_config (publisher or Hugging Face models on NVIDIA L4 GPUs), or troubleshooting provider region, EULA consent, and GPU quota errors.

GoogleCloudPlatform Updated 1.1k repo stars

File contents

googlecloudplatform/genai-factory commit 595fba01bf

Frequently asked questions

npx get-skill add googlecloudplatform/genai-factory-serve-private-models