Results for “llm-evaluation”
11 skillsLangfuse
Provides expertise in Langfuse for LLM observability, including tracing, prompt management, evaluation, and integration with LangChain, LlamaIndex, and OpenAI.
42.4k
Advanced Evaluation
Provides production-grade techniques for evaluating LLM outputs using LLMs as judges, covering direct scoring, pairwise comparison, bias mitigation, rubric generation, and confidence calibration.
16.9k · bundle
Phoenix Evals
Build and run evaluators for AI/LLM applications using Phoenix, covering error analysis, custom evaluators, experiments, and production monitoring.
36.2k · bundle
Langsmith Observability
Debug, evaluate, and monitor LLM applications with tracing, datasets, and built-in evaluators.
10.4k · bundle
More results
Arize Prompt Optimization
Optimizes, improves, and debugs LLM prompts using production trace data, evaluations, and annotations from Arize AI.
36.2k · bundle
Prompt Engineer
Designs, optimizes, and evaluates prompts for LLMs, including structured outputs, chain-of-thought, and evaluation frameworks.
10.4k · bundle
LLM Council
Run Fireworks-hosted open-weight model councils that compare responses and synthesize a final answer.
42.4k · bundle
Prompt Engineer
Designs and optimizes prompts for LLM-powered applications, covering system prompt architecture, context management, output formatting, and evaluation.
0
Agentic Eval
Implement iterative evaluation and refinement loops for AI agent outputs, using self-critique, evaluator-optimizer patterns, and rubric-based scoring to improve quality.
36.2k
LLM Ops
Provides guidance on production AI operations including RAG pipelines, vector databases, embeddings, fine-tuning, prompt engineering, cost estimation, and quality evaluation.
5
LLM Ops
Provides guidance and code for production AI workflows including RAG pipelines, vector databases, embedding indexing, prompt engineering, cost estimation, semantic caching, and quality evaluation.
42.4k