Results for “csp-evaluator”

Create, run, and analyze evaluation suites for Microsoft 365 Copilot declarative agents using the @microsoft/m365-copilot-eval CLI.

Evaluates execution transcripts and output files against a list of expectations, assigning pass/fail verdicts with cited evidence and critiquing the assertions themselves.

Benchmarks language model agents on the C2C multi-agent negotiation task, reporting win rate across starting positions.