Results for “inference-latency”

Trains, evaluates, exports, and runs inference for FastFoundationStereo (FFS) stereo depth estimation models, a distilled variant of FoundationStereo with lower latency.

Authenticates and connects to Google Cloud Agent Platform for inference with Gemini and third-party OpenMaaS models (Llama, DeepSeek, Qwen). Generates code for multiple SDKs, configures endpoints, and troubleshoots common errors.

Orchestrate token-heavy research, coding, and testing by delegating bounded tasks to cheaper subagents while reserving Claude Fable for architecture, synthesis, and final review.

Plans and coordinates the deployment of a model to Amazon SageMaker AI, selecting the appropriate pathway (real-time, serverless, async, batch, or Bedrock CMI) based on model type, traffic, latency, and cost constraints.