Packs
1 packResults for “evaluator”
8 skillsarize-evaluator
Creates and runs LLM-as-judge evaluators on Arize, including managing tasks, column mappings, and continuous monitoring.
36.2k · bundle
phoenix-evals
Build and run evaluators for AI/LLM applications using Phoenix, covering error analysis, custom evaluators, experiments, and production monitoring.
36.2k · bundle
nemo-evaluator-plugin
Run evaluation tasks against a NeMo Platform server using the Evaluator plugin CLI and Python SDK.
2.2k · bundle
More results
arize-link
Generates deep links to the Arize UI for traces, spans, sessions, datasets, labeling queues, evaluators, and annotation configs.
36.2k · bundle
m365-agent-evaluator
Create, run, and analyze evaluation suites for Microsoft 365 Copilot declarative agents using the @microsoft/m365-copilot-eval CLI.
2.7k · bundle
plan-arbiter
Compare, cross-review, and merge competing plans from multiple agents into one executable direction with a clear handoff.
3.4k · bundle
agentic-eval
Implement iterative evaluation and refinement loops for AI agent outputs, using self-critique, evaluator-optimizer patterns, and rubric-based scoring to improve quality.
36.2k
arize-ai-provider-integration
Manage Arize AI integrations that store LLM provider credentials for evaluators and other features. Supports creating, reading, updating, and deleting integrations with providers like OpenAI, Anthropic, Azure OpenAI, AWS Bedrock, Vertex AI, Gemini, and NVIDIA NIM.
36.2k · bundle