Benchmarking Perf

Benchmarking & Performance

Performance Targets

Scalability Results

Excellent scalability: 500x more concepts only 3x slower.

Workflow

1. Save Baseline Before Changes

export CARGO_TERM_PROGRESS_WHEN=never
cargo bench --bench benchmark -- --save-baseline before 2>&1 | grep -E "(^test |time:|Benchmark|bench_|[0-9]+\.[0-9]+ µs)" | tail -30

2. Make Changes

3. Compare Against Baseline

export CARGO_TERM_PROGRESS_WHEN=never
cargo bench --bench benchmark -- --baseline before 2>&1 | grep -E "(time:|Benchmark|bench_|change:)" | tail -30

4. Interpret Results

• Look for time: [lower upper] in criterion output.
• Green = faster, Red = slower.
• Changes > 5% in hot paths require investigation.

Adding a New Benchmark

Edit benches/benchmark.rs. Follow existing patterns:

fn bench_my_operation(c: &mut Criterion) {
    // Setup outside the closure
    let data = prepare_data();

    c.bench_function("my_operation", |b| {
        b.iter(|| {
            // Only the measured code here
            black_box(my_operation(black_box(&data)))
        })
    });
}

Add to criterion_group! at the bottom.

Gotchas

• Never --baseline without first --save-baseline with the same name.
• Don't capture mutable state by reference in criterion closures.
• Use black_box() on inputs AND outputs to prevent dead-code elimination.
• Reservoir benchmarks use new_seeded(..., 42) for reproducibility.