# Benchmark Suite Manager

> Manage benchmarks for algorithm engineering experiments and evaluations

- Skill: `a5c-ai/benchmark-suite-manager-2` (Agent Skill)
- Install (CLI): `npx skillmds@latest add a5c-ai/benchmark-suite-manager-2`
- Raw SKILL.md: https://api.skillmd.com/api/skills/a5c-ai/benchmark-suite-manager-2/raw
- Safety review: pending (external: skill-scanner PASS, skillspector PASS)
- Works with: Claude Code, Claude.ai, OpenAI Codex
- Category: Coding & Dev Tools
- Author: a5c-ai (https://skillmd.com/u/a5c-ai)
- Updated: 2026-09-09
- Page: https://skillmd.com/skills/a5c-ai/benchmark-suite-manager-2

---


# Benchmark Suite Manager

## Purpose

Provides expert guidance on managing benchmark suites for algorithm engineering and experimental evaluation.

## Capabilities

- Standard benchmark suite access (DIMACS, TSPLIB, etc.)
- Instance generation for specific problem classes
- Statistical analysis of results
- Performance comparison tables
- Visualization of scaling behavior
- Reproducibility support

## Usage Guidelines

1. **Suite Selection**: Choose appropriate benchmark suite
2. **Instance Selection**: Select representative instances
3. **Execution**: Run experiments systematically
4. **Analysis**: Perform statistical analysis
5. **Reporting**: Generate comparison tables and plots

## Tools/Libraries

- DIMACS
- TSPLIB
- SuiteSparse Matrix Collection
- Statistical tools