Use Prompt Flow for LLM workflow testing and evaluation
Build a Prompt Flow graph, run interactive and batch tests, inspect traces and evaluation metrics, and promote only reviewed LLM workflow versions.
Prerequisites
Prompt Flow CLI, Python 3.9 through 3.11, promptflow and promptflow-tools packages, configured OpenAI or Azure OpenAI connection, optional VS Code extension.
Installation
Use the upstream install or setup path that matches your environment:
- pip install promptflow promptflow-tools
Requirements and caveats from upstream:
Basic usage or getting-started notes:
To get started quickly, you can use a pre-built development environment. Click the button below to open the repo in GitHub Codespaces, and then continue the readme!
If you want to get started in your local environment, first install the packages:
Extracted from upstream docs: https://raw.githubusercontent.com/microsoft/promptflow/HEAD/README.md