Results for “triton-inference-server”

Serve LLMs and VLMs on NVIDIA Jetson devices using vLLM or SGLang with optimized Docker containers and quantization presets.

Build, deploy, evaluate, debug, and measure latency for a GPU-accelerated FastAPI service that detects whether operators perform assembly-line steps in order via event boundary detection and VLM classification.

Install, configure, and extend Pi, a terminal coding harness, with support for custom providers, models, extensions, skills, packages, themes, SDK integration, RPC mode, JSON event streams, and ecosystem packages for subagent delegation, MCP servers, interactive forms, and web access.

Moves issues and external PRs through a state machine of triage roles, categorizing, verifying, grilling, and writing agent-ready briefs.

Conducts autonomous multi-source research using a planner/executor architecture and an MCP server, with tools for deep research, quick search, report writing, and source retrieval.