Benchmark

Use when choosing between engines or models for an agent pipeline and the answer must come from measurement on your own data, not from marketing pages: speech recognition for meeting recordings, the model that turns a transcript into notes, the critic model that checks it. Runs every variant in an isolated container, measures time, cost per hour of input (USD and RUB, with price source and date) and quality (WER/CER and course terms for ASR; code checks plus a judge of a different model for LLM steps), writes results.json/csv and one static analytics page. Triggers on "бенчмарк", "сравни движки", "сколько стоит час записи", "какую модель взять для пайплайна", "benchmark the pipeline", "compare ASR engines".

serejaris Updated 244 repo stars
Every folder carries its own rules file: the HQ sees the whole system, a department sees only its domain

File contents

serejaris/personal-corp-os commit f34255753f

Frequently asked questions

npx get-skill add serejaris/benchmark