Genkit Go
Genkit Go is an AI SDK for Go that provides generation, structured output, streaming, tool calling, prompts, and flows with a unified interface across model providers.
Hello World
package main
import (
"context"
"fmt"
"log"
"net/http"
"github.com/genkit-ai/genkit/go/ai"
"github.com/genkit-ai/genkit/go/genkit"
"github.com/genkit-ai/genkit/go/plugins/googlegenai"
"github.com/genkit-ai/genkit/go/plugins/server"
)
func main() {
ctx := context.Background()
g := genkit.Init(ctx, genkit.WithPlugins(&googlegenai.GoogleAI{}))
genkit.DefineFlow(g, "jokeFlow", func(ctx context.Context, topic string) (string, error) {
return genkit.GenerateText(ctx, g,
ai.WithModelName("googleai/gemini-flash-latest"),
ai.WithPrompt("Tell me a joke about %s", topic),
)
})
mux := http.NewServeMux()
for _, f := range genkit.ListFlows(g) {
mux.HandleFunc("POST /"+f.Name(), genkit.Handler(f))
}
log.Fatal(server.Start(ctx, "127.0.0.1:8080", mux))
}
Core Features
Load the appropriate reference based on what you need:
| Feature |
Reference |
When to load |
| Initialization |
references/getting-started.md |
Setting up genkit.Init, plugins, the *Genkit instance pattern |
| Generation |
references/generation.md |
Generate, GenerateText, GenerateData, streaming, output formats |
| Prompts |
references/prompts.md |
DefinePrompt, DefineDataPrompt, .prompt files, schemas |
| Tools |
references/tools.md |
DefineTool, tool interrupts, RestartWith/RespondWith |
| Flows & HTTP |
references/flows-and-http.md |
DefineFlow, DefineStreamingFlow, genkit.Handler, HTTP serving |
| Model Providers |
references/providers.md |
Google AI, Vertex AI, Anthropic, OpenAI-compatible, Ollama setup |
Genkit CLI
Check if installed: genkit --version
Installation:
curl -sL cli.genkit.dev | bash
Key commands:
# Start app with Developer UI (tracing, flow testing) at http://localhost:4000
genkit start -- go run .
genkit start -o -- go run . # also opens browser
# Run a flow directly from the CLI
genkit flow:run myFlow '{"data": "input"}'
genkit flow:run myFlow '{"data": "input"}' --stream # with streaming
genkit flow:run myFlow '{"data": "input"}' --wait # wait for completion
# Look up Genkit documentation
genkit docs:search "streaming" go
genkit docs:list go
genkit docs:read go/flows.md
See references/getting-started.md for full CLI and Developer UI details.
Key Guidance
- Pass
g explicitly. The *Genkit instance returned by genkit.Init is the central registry. Pass it to all Genkit functions rather than storing it as a global. This is a core pattern throughout the SDK.
- Wrap AI logic in flows. Flows give you tracing, observability, HTTP deployment via
genkit.Handler, and the ability to test from the Developer UI and CLI. Any generation call worth keeping should live in a flow.
- Use
jsonschema:"description=..." struct tags on output types. The model uses these descriptions to understand what each field should contain. Without them, structured output quality drops significantly.
- Write good tool descriptions. The model decides which tools to call based on their description string. Vague descriptions lead to missed or incorrect tool calls.
- Use
.prompt files for complex prompts. They separate prompt content from Go code, support Handlebars templating, and can be iterated on without recompilation. Code-defined prompts are better for simple, single-line cases.
- Look up the latest model IDs. Model names change frequently. Check provider documentation for current model IDs rather than relying on hardcoded names. See references/providers.md.
1---
2name: developing-genkit-go
3description: Develop AI-powered applications using Genkit in Go. Use when the user asks to build AI features, agents, flows, or tools in Go using Genkit, or when working with Genkit Go code involving generation, prompts, streaming, tool calling, or model providers.
4metadata:
5 genkit-managed: true
6---
7
8# Genkit Go
9
10Genkit Go is an AI SDK for Go that provides generation, structured output, streaming, tool calling, prompts, and flows with a unified interface across model providers.
11
12## Hello World
13
14```go
15package main
16
17import (
18 "context"
19 "fmt"
20 "log"
21 "net/http"
22
23 "github.com/genkit-ai/genkit/go/ai"
24 "github.com/genkit-ai/genkit/go/genkit"
25 "github.com/genkit-ai/genkit/go/plugins/googlegenai"
26 "github.com/genkit-ai/genkit/go/plugins/server"
27)
28
29func main() {
30 ctx := context.Background()
31 g := genkit.Init(ctx, genkit.WithPlugins(&googlegenai.GoogleAI{}))
32
33 genkit.DefineFlow(g, "jokeFlow", func(ctx context.Context, topic string) (string, error) {
34 return genkit.GenerateText(ctx, g,
35 ai.WithModelName("googleai/gemini-flash-latest"),
36 ai.WithPrompt("Tell me a joke about %s", topic),
37 )
38 })
39
40 mux := http.NewServeMux()
41 for _, f := range genkit.ListFlows(g) {
42 mux.HandleFunc("POST /"+f.Name(), genkit.Handler(f))
43 }
44 log.Fatal(server.Start(ctx, "127.0.0.1:8080", mux))
45}
46```
47
48## Core Features
49
50Load the appropriate reference based on what you need:
51
52| Feature | Reference | When to load |
53| --- | --- | --- |
54| Initialization | [references/getting-started.md](references/getting-started.md) | Setting up `genkit.Init`, plugins, the `*Genkit` instance pattern |
55| Generation | [references/generation.md](references/generation.md) | `Generate`, `GenerateText`, `GenerateData`, streaming, output formats |
56| Prompts | [references/prompts.md](references/prompts.md) | `DefinePrompt`, `DefineDataPrompt`, `.prompt` files, schemas |
57| Tools | [references/tools.md](references/tools.md) | `DefineTool`, tool interrupts, `RestartWith`/`RespondWith` |
58| Flows & HTTP | [references/flows-and-http.md](references/flows-and-http.md) | `DefineFlow`, `DefineStreamingFlow`, `genkit.Handler`, HTTP serving |
59| Model Providers | [references/providers.md](references/providers.md) | Google AI, Vertex AI, Anthropic, OpenAI-compatible, Ollama setup |
60
61## Genkit CLI
62
63Check if installed: `genkit --version`
64
65**Installation:**
66```bash
67curl -sL cli.genkit.dev | bash
68```
69
70**Key commands:**
71
72```bash
73# Start app with Developer UI (tracing, flow testing) at http://localhost:4000
74genkit start -- go run .
75genkit start -o -- go run . # also opens browser
76
77# Run a flow directly from the CLI
78genkit flow:run myFlow '{"data": "input"}'
79genkit flow:run myFlow '{"data": "input"}' --stream # with streaming
80genkit flow:run myFlow '{"data": "input"}' --wait # wait for completion
81
82# Look up Genkit documentation
83genkit docs:search "streaming" go
84genkit docs:list go
85genkit docs:read go/flows.md
86```
87
88See [references/getting-started.md](references/getting-started.md) for full CLI and Developer UI details.
89
90## Key Guidance
91
92- **Pass `g` explicitly.** The `*Genkit` instance returned by `genkit.Init` is the central registry. Pass it to all Genkit functions rather than storing it as a global. This is a core pattern throughout the SDK.
93- **Wrap AI logic in flows.** Flows give you tracing, observability, HTTP deployment via `genkit.Handler`, and the ability to test from the Developer UI and CLI. Any generation call worth keeping should live in a flow.
94- **Use `jsonschema:"description=..."` struct tags on output types.** The model uses these descriptions to understand what each field should contain. Without them, structured output quality drops significantly.
95- **Write good tool descriptions.** The model decides which tools to call based on their description string. Vague descriptions lead to missed or incorrect tool calls.
96- **Use `.prompt` files for complex prompts.** They separate prompt content from Go code, support Handlebars templating, and can be iterated on without recompilation. Code-defined prompts are better for simple, single-line cases.
97- **Look up the latest model IDs.** Model names change frequently. Check provider documentation for current model IDs rather than relying on hardcoded names. See [references/providers.md](references/providers.md).