Plugins

1 plugin

Run Agent Evaluation

Sets up evaluation framework, runs benchmarks, and produces comparative analysis of agent performance.

9 skills · plugin

Results for “benchmarks”

2 skills

Benchmarks LLM bias by scoring responses to automatically generated open-ended questions across sensitive attributes, producing a composite fitness score from 0 to 5.

More results

Benchmarks large audio-language models against adversarial audio attacks using the CAA dataset, computing WER, ROUGE-L, cosine similarity, and coherence scores to assess robustness in conversational settings.