Build and optimize agent eval workflows with Kiln

Use Kiln to create eval datasets, rate outputs, optimize prompts and models, and ship the same AI task or agent definition from a local workbench into production code.

agentskillexchange Updated 61 repo stars

File contents

Build and optimize agent eval workflows with Kiln

Use Kiln to create eval datasets, rate outputs, optimize prompts and models, and ship the same AI task or agent definition from a local workbench into production code.

Prerequisites

Kiln Desktop or Python 3 with kiln-ai, model provider API keys or local Ollama

Installation

Install or set up from the source-backed instructions:

Install Kiln Desktop from the official download page for a no-code eval workbench, or install the open Python library with pip install kiln-ai when the workflow needs to run from code.

Documentation

Source

agentskillexchange/skills commit 34e0d58fe1

Frequently asked questions

npx get-skill add agentskillexchange/build-and-optimize-agent-eval-workflows-with-kiln