Solver Benchmark Benchmark Workflow

Benchmark Workflow

Benchmark Workflow

DiffractionSpec (YAML)
        │
        ├──> OrcaWave Runner ──> DiffractionResults
        │
        ├──> AQWA Runner ──────> DiffractionResults
        │
        └──> BEMRosetta Runner ─> DiffractionResults
                                        │
                                        v
                            MultiSolverComparator
                                        │
                            ┌───────────┴───────────┐
                            │                       │
                    Pairwise Stats          Consensus Metrics
                    (correlation,           (FULL/MAJORITY/
                     RMS error)              SPLIT/NONE)
                            │                       │
                            └───────────┬───────────┘
                                        │
                                        v
                              BenchmarkPlotter
                                        │
                        ┌───────────────┼───────────────┐
                        │               │               │

*See sub-skills for full details.*