Results for “tensorrt”
41 skills
orchestra-research tensorrt-llm
Optimizes LLM inference with NVIDIA TensorRT for maximum throughput and lowest latency on NVIDIA GPUs (A100/H100).
10.4k · bundle
nvidia tao-launch-workflow
Collects launch inputs and runs preflight checks before executing TAO workflows such as AutoML, training, evaluation, inference, export, TensorRT engine generation, or DEFT jobs on supported platforms.
2.2k · bundle
nvidia tao-finetune-clip
Fine-tune and deploy CLIP vision-language models for zero-shot classification, image-text retrieval, and embedding extraction with ONNX and TensorRT support.
2.2k · bundle
nvidia deepstream-dev
Build video analytics pipelines using NVIDIA DeepStream SDK 9.0 with Python pyservicemaker API, including GStreamer-based video processing, TensorRT inference integration, object detection/tracking, and Kafka/message broker integration.
2.2k · bundle
nvidia deepstream-import-vision-model
Import object detection models from HuggingFace or NVIDIA NGC into a DeepStream pipeline with automated ONNX download, TensorRT engine build, custom parser, multi-stream benchmark, and PDF report generation.
2.2k · bundle
tianhao909 tensorrt-llm
Optimizes LLM inference with NVIDIA TensorRT for maximum throughput and lowest latency. Use for production deployment on NVIDIA GPUs (A100/H100), when you need 10-100x faster inference than PyTorch, or for serving models with quantization (FP8/INT4), in-flight batching, and multi-GPU scaling.
1 · bundle
More results
qcmuu tensorrt-llm
Optimizes LLM inference with NVIDIA TensorRT for maximum throughput and lowest latency. Use for production deployment on NVIDIA GPUs (A100/H100), when you need 10-100x faster inference than PyTorch, or for serving models with quantization (FP8/INT4), in-flight batching, and multi-GPU scaling.
0 · bundle
nvidia tao-train-centerpose
Train, evaluate, export, and run inference for CenterPose models used in 6-DoF object pose estimation with keypoint regression.
2.2k · bundle
nvidia tao-train-pointpillars
Train, evaluate, export, prune, and run inference for PointPillars 3D object detection models from LiDAR point clouds using NVIDIA TAO.
2.2k · bundle
nvidia tao-train-mask2former
Train, evaluate, export, quantize, and run inference on Mask2Former models for panoptic, instance, and semantic segmentation using NVIDIA TAO.
2.2k · bundle
nvidia tao-port-huggingface-model
Integrate a HuggingFace computer vision model into the NVIDIA TAO Toolkit ecosystem, covering the full pipeline from prerequisites to container testing.
2.2k · bundle
nvidia tao-train-oneformer
Train, evaluate, export, quantize, and run inference for a TAO OneFormer model that performs panoptic, instance, and semantic segmentation using task-conditioned queries.
2.2k · bundle
nvidia tao-train-depth-anything-v2
Train, evaluate, export, and run inference for monocular depth estimation models using Metric Depth Anything v2 or Relative Depth Anything architectures via the TAO toolkit.
2.2k · bundle
nvidia tao-train-rtdetr
Train, evaluate, distill, quantize, export, and run inference for RT-DETR object detection models using NVIDIA TAO.
2.2k · bundle
nvidia tao-train-ocrnet
Trains, evaluates, exports, prunes, quantizes, retrains, and runs inference for TAO OCRNet models for scene text recognition from cropped text-region images, supporting CTC and attention-based decoders.
2.2k · bundle
nvidia tao-train-mask-auto-encoder
Train, evaluate, export, and run inference for Masked Auto-Encoder (MAE) models for self-supervised pretraining and fine-tuning of visual representations.
2.2k · bundle
nvidia tao-train-ocdnet
Trains, evaluates, exports, prunes, quantizes, retrains, and runs inference for OCDNet scene text detection models using TAO, detecting arbitrary-oriented text regions in natural images.
2.2k · bundle
nvidia tao-train-segformer
Trains, evaluates, exports, quantizes, and runs inference for SegFormer semantic segmentation models using NVIDIA TAO.
2.2k · bundle
nvidia tao-train-optical-inspection
Trains, evaluates, exports, and runs inference for Siamese-network-based optical inspection models to detect manufacturing defects and quality issues in image pairs.
2.2k · bundle
nvidia tao-train-mask-grounding-dino
Trains, evaluates, exports, quantizes, and runs inference for a Mask Grounding DINO model for open-set instance segmentation guided by text prompts.
2.2k · bundle
tianhao909 tensorboard
Visualize training metrics, debug models with histograms, compare experiments, visualize model graphs, and profile performance with TensorBoard - Google's ML visualization toolkit
1 · bundle
bobmatnyc ort
ONNX Runtime in Rust via the `ort` crate (2.x): loading sessions, configuring CPU/CoreML/CUDA execution providers, tensor I/O with ndarray, async-safe spawn_blocking wrapping, global thread-pool init, and debugging provider/opset issues
71 · bundle
qhjqhj00 tensorboard
Visualize training metrics, debug models with histograms, compare experiments, visualize model graphs, and profile performance with TensorBoard.
3 · bundle
orchestra-research tensorboard
Visualize training metrics, debug models with histograms, compare experiments, visualize model graphs, and profile performance using TensorBoard.
10.4k · bundle
qcmuu tensorboard
Visualize training metrics, debug models with histograms, compare experiments, visualize model graphs, and profile performance with TensorBoard - Google's ML visualization toolkit
0 · bundle
nvidia tao-train-image-classification
Train, evaluate, distill, quantize, export, and run inference for PyTorch-based TAO image classification models with support for multiple backbones.
2.2k · bundle
nvidia tao-run-on-slurm
Submit and manage TAO training, evaluation, and inference jobs on SLURM GPU clusters over SSH with sbatch/srun, Pyxis/Enroot containers, and Lustre-backed storage.
2.2k · bundle
nvidia tao-train-nvdinov2
Trains vision transformers via self-distillation without labels for self-supervised visual representation learning, and supports export and inference of NVDINOv2 backbones.
2.2k · bundle
nvidia tao-train-foundation-stereo
Trains, evaluates, exports, and runs inference on FoundationStereo models for stereo depth estimation and 3D reconstruction from stereo image pairs.
2.2k · bundle
nvidia tao-train-grounding-dino
Trains, evaluates, exports, quantizes, and runs inference for a Grounding DINO model that detects objects described by text prompts without a fixed class vocabulary.
2.2k · bundle
nvidia tao-train-fast-foundation-stereo
Trains, evaluates, exports, and runs inference for FastFoundationStereo (FFS) stereo depth estimation models, a distilled variant of FoundationStereo with lower latency.
2.2k · bundle
qhjqhj00 bleurt
Evaluates the correlation between automatic text generation scores and human quality ratings, including robustness to domain and quality drift, using metrics like Kendall's Tau and Pearson correlation.
3
neuralblitz tensorflow
Build and deploy machine learning models with TensorFlow, covering Keras, data pipelines, and production serving.
1
chimeranext machine-learning
Integrates on-device and cloud machine learning into Flutter apps with TensorFlow Lite and Firebase ML Kit, covering image classification, object detection, OCR, face detection, and barcode scanning.
4
jiachen-t-wang donut-document-understanding-transformer-without-ocr-arxiv-2
Donut: Document Understanding Transformer without OCR
6
orchestra-research ray-data
Process large-scale ML datasets with distributed streaming execution across CPU/GPU, supporting Parquet, CSV, JSON, images, and integration with PyTorch, TensorFlow, and Ray Train.
10.4k · bundle