Plugins

2 plugins

Run Agent Evaluation

Sets up evaluation framework, runs benchmarks, and produces comparative analysis of agent performance.

9 skills · plugin

Prototyping Testing

Prototyping and testing skills: wireframe specs, usability heuristics, heuristic evaluations, accessibility audits, A/B test design, and benchmark analysis.

8 skills · plugin

Results for “benchmark”

14 skills

Jetson LLM Benchmark

Benchmark Jetson LLM/VLM serving performance across vLLM, llama.cpp, and Ollama with structured JSON output.

Create new skills, modify existing ones, and measure their performance through iterative evaluation and benchmarking.

Microbenchmarking

Create, run, configure, and review BenchmarkDotNet microbenchmarks for .NET code, covering project setup, comparison strategies, and cost-aware execution.

Tilegym Adding Cutile Kernel

Add a new cuTile GPU kernel operator to TileGym, covering dispatch registration, backend implementation, exports, tests, and benchmarks.

Run config-driven performance benchmarks against a deployed NVIDIA RAG Blueprint server, including profiling and load testing, with a unified report.

Evaluates RAG pipelines using a filesystem-based benchmark with corpus/ and train.json, running evaluate_rag.py to tune retrieval and generation flags and interpret RAGAS metrics.

More results

Huggingface Best

Queries Hugging Face benchmark leaderboards to find the best AI models for a task, filters by device constraints, and returns a ranked comparison table with scores.

Jetson Speculative Decoding

Reduce per-token latency on Jetson vLLM servers by appending speculative decoding configuration, with guidance on when to enable and how to benchmark the improvement.

Nemotron Customize

Plan, configure, and chain Nemotron model customization steps into single-step or multi-step pipelines for curation, translation, fine-tuning, RL alignment, benchmarking, checkpoint conversion, optimization, and evaluation.

Deepstream Import Vision Model

Import object detection models from HuggingFace or NVIDIA NGC into a DeepStream pipeline with automated ONNX download, TensorRT engine build, custom parser, multi-stream benchmark, and PDF report generation.

Nemo Evaluator Plugin

Run evaluation tasks against a NeMo Platform server using the Evaluator plugin CLI and Python SDK.

Arize Experiment

Creates, runs, and analyzes Arize experiments for evaluating and comparing model performance using the ax CLI.

36.2k · bundle

Digital Health Clinical Asr Build

Curates clinical-specialty term lists, generates IPA-tagged synthetic audio via TTS, and produces NeMo-format manifests for ASR benchmark evaluation.

Guides users through defining goals, metrics, and scope, then runs an autonomous loop of code changes, testing, measuring, and keeping or discarding results for any programming task with a measurable outcome.