Results for “jetson”
8 skills
nvidia Jetson LLM Benchmark
Benchmark Jetson LLM/VLM serving performance across vLLM, llama.cpp, and Ollama with structured JSON output.
2.2k · bundle
nvidia Jetson LLM Serve
Serve LLMs and VLMs on NVIDIA Jetson devices using vLLM or SGLang with optimized Docker containers and quantization presets.
2.2k · bundle
nvidia Jetson Print Device Info
Captures a baseline snapshot of a Jetson device's module model, L4T version, kernel, OS version, and power mode for performance testing or verification.
2.2k · bundle
More results
nvidia Jetson Customize Camera
Enable MIPI/GMSL camera sensors on a Jetson Thor or Orin custom carrier by rendering a kernel-DT overlay from the in-tree sensor DTSI.
2.2k · bundle
nvidia Jetson Speculative Decoding
Reduce per-token latency on Jetson vLLM servers by appending speculative decoding configuration, with guidance on when to enable and how to benchmark the improvement.
2.2k · bundle
nvidia Jetson Inference Mem Tune
Recommends an inference runtime and memory-related launch flags for LLM/VLM workloads on NVIDIA Jetson devices, based on a live memory audit snapshot.
2.2k · bundle
yanacuti1121 Headroom
Context compression for YAMTAM — nén JSON/structured tool output trước khi vào LLM. Hiệu quả với JSON (50-72% tiết kiệm); text thuần cần bản [all].
2
nvidia Deepstream Generate Pipeline
Builds and validates DeepStream GStreamer pipelines through an interactive questionnaire and a BM25 retrieval engine over 270+ verified pipelines.
2.2k · bundle