1525 07 Operations Runbook 5edc8070

📖 Operations Runbook: terraform-e2e

• ⚡ Quick Reference
• 📋 1. Daily Operations
• 🚨 2. Incident Response
• 🔧 3. Common Procedures
• 🕐 4. Maintenance Windows
• 📞 5. Contacts & Escalation
• 📝 6. Change Log
• References

Generated by as-built agent | 2026-02-26

Version: 1.0 Date: 2026-02-26 Environment: dev Region: swedencentral

⚡ Quick Reference

Critical Resources

📋 1. Daily Operations

1.1 Health Checks

Morning Health Check:

1. ✅ Verify frontend and backend return HTTP response
2. ✅ Confirm App Services are Running
3. ✅ Confirm SQL server state is Ready and DB state is Online
4. ✅ Check last 24h smart detector alerts for anomalies

KQL Query - System Health Overview:

requests
| where timestamp > ago(24h)
| summarize
    RequestCount = count(),
    FailedRequests = countif(success == false),
    P95DurationMs = percentile(duration, 95)
  by cloud_RoleName, bin(timestamp, 1h)
| order by timestamp desc

1.2 Log Review

Priority Logs to Review:

🚨 2. Incident Response

2.1 Severity Definitions

2.2 Runbooks by Alert

🔧 3. Common Procedures

3.1 Restart Services

az webapp restart --name app-terraform-e2e-dev-3hpu --resource-group rg-terraform-e2e-dev
az webapp restart --name app-terraform-e2e-fe-dev-3hpu --resource-group rg-terraform-e2e-dev

3.2 Validate Runtime State

az webapp show --name app-terraform-e2e-dev-3hpu --resource-group rg-terraform-e2e-dev --query "{name:name,state:state,httpsOnly:httpsOnly,host:defaultHostName}" -o table
az webapp show --name app-terraform-e2e-fe-dev-3hpu --resource-group rg-terraform-e2e-dev --query "{name:name,state:state,httpsOnly:httpsOnly,host:defaultHostName}" -o table
az sql server show --name sql-terraform-e2e-dev-3hpu --resource-group rg-terraform-e2e-dev --query "{name:name,state:state,publicNetworkAccess:publicNetworkAccess,version:version}" -o table

3.3 Terraform Drift Check

cd infra/terraform/terraform-e2e
terraform plan -detailed-exitcode

3.4 Secret/RBAC Validation

az keyvault show --name kv-tfe2dev-3hpu --resource-group rg-terraform-e2e-dev --query "{name:name,enableRbacAuthorization:properties.enableRbacAuthorization,publicNetworkAccess:properties.publicNetworkAccess}" -o table
az role assignment list --scope /subscriptions/00858ffc-dded-4f0f-8bbf-e17fff0d47d9/resourceGroups/rg-terraform-e2e-dev/providers/Microsoft.KeyVault/vaults/kv-tfe2dev-3hpu -o table

🕐 4. Maintenance Windows

📞 5. Contacts & Escalation

Escalation Path

1. L1 triages within SLA window.
2. If unresolved in 30 minutes (P1/P2), escalate to L2.
3. If platform-wide or policy-related blocker persists, escalate to L3.

📝 6. Change Log

References