Observability Operations
Purpose
You make systems diagnosable. Your work should help engineers answer what is broken, who is affected, why it happened, and what action is safe next.
Operational context
- Read
references/workflow.md.
- Identify target platform, observability stack, required signals, critical user journeys, retention, privacy, and cost constraints.
- Verify current documentation for telemetry SDKs, collectors, alerting rules, dashboard provisioning, log pipelines, and semantic conventions.
Safe change sequence
- Define the signal model: metrics, logs, traces, profiles, events, or a combination.
- Map signals to user impact using RED, USE, four golden signals, or SLI/SLO language.
- Design labels, cardinality limits, trace/log correlation, retention, alert severity, and routing.
- Implement instrumentation, dashboards, alerts, provisioning, or pipeline configuration.
- Validate by generating signals, checking dashboard data, testing alerts, reviewing cardinality, and confirming trace-log correlation.
Safety rules
- Use Context7 MCP for current cloud, Kubernetes, IaC, CI/CD, container, observability, security, network, API, CLI, provider, and configuration documentation whenever the task depends on external technology behavior.
Change record
Provide signal goals, documentation validation status, instrumentation/config changes, dashboard and alert behavior, validation steps, privacy/cost risks, and assumptions.
Verification
- Alerts must be actionable and tied to user impact where possible.
- Critical alerts need runbook hints.
- Avoid high-cardinality labels and duplicated metrics.
- Do not log secrets or sensitive personal data.
- Preserve correlation IDs across logs, metrics, and traces.
Handoff
For incidents, pair with incident-troubleshooting. For Kubernetes monitoring, pair with kubernetes-operations. For CI/deploy telemetry, pair with cicd-automation.
References
references/workflow.md for observability design and validation checklist.
1---2name: observability-operations3description: Use for metrics, logs, traces, dashboards, alerting, SLI/SLO design, OpenTelemetry, Prometheus, Grafana, Loki, ELK, OpenSearch, Tempo, Jaeger, production diagnostics, and alert noise reduction.4---56# Observability Operations78## Purpose910You make systems diagnosable. Your work should help engineers answer what is broken, who is affected, why it happened, and what action is safe next.1112## Operational context13141. Read `references/workflow.md`.152. Identify target platform, observability stack, required signals, critical user journeys, retention, privacy, and cost constraints.163. Verify current documentation for telemetry SDKs, collectors, alerting rules, dashboard provisioning, log pipelines, and semantic conventions.1718## Safe change sequence19201. Define the signal model: metrics, logs, traces, profiles, events, or a combination.212. Map signals to user impact using RED, USE, four golden signals, or SLI/SLO language.223. Design labels, cardinality limits, trace/log correlation, retention, alert severity, and routing.234. Implement instrumentation, dashboards, alerts, provisioning, or pipeline configuration.245. Validate by generating signals, checking dashboard data, testing alerts, reviewing cardinality, and confirming trace-log correlation.2526## Safety rules2728- Use Context7 MCP for current cloud, Kubernetes, IaC, CI/CD, container, observability, security, network, API, CLI, provider, and configuration documentation whenever the task depends on external technology behavior.2930## Change record3132Provide signal goals, documentation validation status, instrumentation/config changes, dashboard and alert behavior, validation steps, privacy/cost risks, and assumptions.3334## Verification3536- Alerts must be actionable and tied to user impact where possible.37- Critical alerts need runbook hints.38- Avoid high-cardinality labels and duplicated metrics.39- Do not log secrets or sensitive personal data.40- Preserve correlation IDs across logs, metrics, and traces.4142## Handoff4344For incidents, pair with `incident-troubleshooting`. For Kubernetes monitoring, pair with `kubernetes-operations`. For CI/deploy telemetry, pair with `cicd-automation`.4546## References4748- `references/workflow.md` for observability design and validation checklist.
ashermahonin