Sagemaker Benchmark

Run a managed performance benchmark against a deployed Amazon SageMaker AI endpoint using SageMaker AI inference benchmarking (part of optimized GenAI inference recommendations; NVIDIA AIPerf under the hood). Measures TTFT, ITL, request-latency percentiles, and throughput. Use when the user asks to benchmark / load-test / measure the performance of a live endpoint.

aws-samples Updated 141 repo stars
From model to production: agentic AI model deployment on Amazon SageMaker

File contents

aws-samples/sample-sagemaker-agentic-model-deployment commit e87f885f1f

Frequently asked questions

npx get-skill add aws-samples/sagemaker-benchmark