Results for “model-evaluation”
14 skills
github arize-experiment
Creates, runs, and analyzes Arize experiments for evaluating and comparing model performance using the ax CLI.
36.2k · bundle
microsoft finetuning
Fine-tune models on Azure AI Foundry using SFT, DPO, or RFT, covering dataset preparation, training job submission, deployment, and evaluation.
2.7k · bundle
google agent-platform-eval-flywheel
Measures and improves the quality of AI models and agents on Google Cloud using the Eval Quality Flywheel methodology, including dataset creation, metric selection, failure analysis, and iterative improvement.
14.4k · bundle
huggingface huggingface-community-evals
Run evaluations for Hugging Face Hub models using inspect-ai and lighteval on local hardware, with backend selection between vLLM, Transformers, and accelerate.
10.8k · bundle
nvidia tao-train-deformable-detr
Train, evaluate, export, quantize, and run inference for a Deformable DETR 2D object detection model using TAO, with deformable attention for efficient multi-scale feature processing.
2.2k · bundle
More results
nvidia tao-train-single-step
Fine-tune a TAO model with standard supervised training, evaluation, and export, with AutoML bypass and platform-specific credential intake.
2.2k · bundle
nvidia nemotron-customize
Plan, configure, and chain Nemotron model customization steps into single-step or multi-step pipelines for curation, translation, fine-tuning, RL alignment, benchmarking, checkpoint conversion, optimization, and evaluation.
2.2k · bundle
github threat-model-analyst
Performs STRIDE-A threat model analysis of repositories and systems, producing architecture overviews, DFD diagrams, prioritized findings, and executive assessments. Supports both single analysis and incremental updates with change tracking.
36.2k · bundle
google agent-platform-model-registry
Manage machine learning models in the Agent Platform Model Registry: list, describe, upload, update, and delete models and their versions.
14.4k
nvidia tao-train-rtdetr
Train, evaluate, distill, quantize, export, and run inference for RT-DETR object detection models using NVIDIA TAO.
2.2k · bundle
microsoft microsoft-foundry
Deploy, evaluate, fine-tune, and manage Microsoft Foundry agents end-to-end using Azure Developer CLI and MCP tools.
2.7k · bundle
anthropic mcp-builder
Guides the creation of high-quality MCP servers that enable LLMs to interact with external services through well-designed tools, covering planning, implementation, testing, and evaluation.
158k · bundle
microsoft mcp-builder
Guides the creation of high-quality MCP servers that enable LLMs to interact with external services through well-designed tools, covering planning, implementation, testing, and evaluation across multiple programming languages.
2.7k · bundle
nvidia tao-run-deft-aoi
Automates the full DEFT AOI improvement loop for NVIDIA TAO VisualChangeNet / ChangeNet PCB inspection models, including baseline evaluation, RCA, synthetic defect generation, data mining, retraining, and deployment gating until KPI targets are met.
2.2k · bundle