agentskillexchange Constrain agent outputs with Outlines structured generation
Force LLM outputs into typed schemas, enums, JSON-like structures, and routing records during generation instead of repairing malformed text afterward.
Prerequisites
Python, Outlines, supported LLM runtime or provider, schema definitions
Installation
Use the upstream install or setup path that matches your environment:
- pip install outlines
Requirements and caveats from upstream:
- Outlines follows a simple pattern that mirrors Python's own type system. Simply specify the desired output type, and Outlines will ensure your data matches that structure exactly:
- python
- | Custome types | Intuitive interface to build complex types | Python Types Guide → |
Basic usage or getting-started notes:
import outlines
from transformers import AutoTokenizer, AutoModelForCausalLM
MODEL_NAME = "microsoft/Phi-3-mini-4k-instruct"
Extracted from upstream docs: https://raw.githubusercontent.com/dottxt-ai/outlines/HEAD/README.md