# CI CD And Automation > Automates CI/CD pipeline setup. Use when setting up or modifying build and deployment pipelines. Use when you need to automate quality gates, configure test runners in CI, or establish deployment strategies. - Skill: `tomevault-io/ci-cd-and-automation` (Agent Skill, multi-file: 2 files) - Install (CLI): `npx skillmds@latest add tomevault-io/ci-cd-and-automation` - Raw SKILL.md: https://api.skillmd.com/api/skills/tomevault-io/ci-cd-and-automation/raw - Safety review: pending (external: skill-scanner PASS, skillspector PASS) - Works with: Claude Code, Claude.ai, OpenAI Codex - Category: DevOps & Infra - Author: tomevault-io (https://skillmd.com/u/tomevault-io) - Updated: 2026-09-17 - Page: https://skillmd.com/skills/tomevault-io/ci-cd-and-automation --- # CI/CD and Automation ## Overview Automate quality gates so that no change reaches production without passing tests, lint, static analysis, and build. CI/CD is the enforcement mechanism for every other skill — it catches what humans and agents miss, and it does so consistently on every single change. **Shift Left:** Catch problems as early in the pipeline as possible. A bug caught in linting costs minutes; the same bug caught in production costs hours. Move checks upstream — static analysis before tests, tests before staging, staging before production. **Faster is Safer:** Smaller batches and more frequent releases reduce risk, not increase it. A deployment with 3 changes is easier to debug than one with 30. Frequent releases build confidence in the release process itself. ## When to Use - Setting up a new project's CI pipeline - Adding or modifying automated checks - Configuring deployment pipelines - When a change should trigger automated verification - Debugging CI failures ## The Quality Gate Pipeline Every change goes through these gates before merge: ``` Pull Request Opened │ ▼ ┌─────────────────┐ │ LINT CHECK │ golangci-lint, gofmt │ ↓ pass │ │ STATIC ANALYSIS│ go vet │ ↓ pass │ │ UNIT TESTS │ go test ./... │ ↓ pass │ │ BUILD │ go build ./... │ ↓ pass │ │ INTEGRATION │ API/DB tests │ ↓ pass │ │ RACE (optional)│ go test -race ./... │ ↓ pass │ │ SECURITY AUDIT │ govulncheck ./... │ ↓ pass │ │ PACKAGING │ release artifact smoke check └─────────────────┘ │ ▼ Ready for review ``` **No gate can be skipped.** If lint fails, fix lint — don't disable the rule. If a test fails, fix the code — don't skip the test. ## GitHub Actions Configuration ### Basic CI Pipeline ```yaml # .github/workflows/ci.yml name: CI on: pull_request: branches: [main] push: branches: [main] jobs: quality: runs-on: ubuntu-latest steps: - uses: actions/checkout@v4 - uses: actions/setup-go@v5 with: go-version-file: go.mod cache: true - name: Download dependencies run: go mod download - name: Lint run: golangci-lint run - name: Static analysis run: go vet ./... - name: Test run: go test ./... -cover - name: Build run: go build ./... - name: Security audit run: govulncheck ./... ``` ### With Database Integration Tests ```yaml integration: runs-on: ubuntu-latest services: postgres: image: postgres:16 env: POSTGRES_DB: testdb POSTGRES_USER: ci_user POSTGRES_PASSWORD: ${{ secrets.CI_DB_PASSWORD }} ports: - 5432:5432 options: >- --health-cmd pg_isready --health-interval 10s --health-timeout 5s --health-retries 5 steps: - uses: actions/checkout@v4 - uses: actions/setup-go@v5 with: go-version-file: go.mod cache: true - run: go mod download - name: Run migrations run: go run ./cmd/migrate up env: DATABASE_URL: postgresql://ci_user:${{ secrets.CI_DB_PASSWORD }}@localhost:5432/testdb?sslmode=disable - name: Integration tests run: go test ./... -run Integration env: DATABASE_URL: postgresql://ci_user:${{ secrets.CI_DB_PASSWORD }}@localhost:5432/testdb?sslmode=disable ``` > **Note:** Even for CI-only test databases, use GitHub Secrets for credentials rather than hardcoding values. This builds good habits and prevents accidental reuse of test credentials in other contexts. ### Race and Smoke Tests ```yaml race: runs-on: ubuntu-latest steps: - uses: actions/checkout@v4 - uses: actions/setup-go@v5 with: go-version-file: go.mod cache: true - run: go mod download - name: Build run: go build ./... - name: Run race detector run: go test -race ./... - uses: actions/upload-artifact@v4 if: failure() with: name: race-logs path: . ``` ## Feeding CI Failures Back to Agents The power of CI with AI agents is the feedback loop. When CI fails: ``` CI fails │ ▼ Copy the failure output │ ▼ Feed it to the agent: "The CI pipeline failed with this error: [paste specific error] Fix the issue and verify locally before pushing again." │ ▼ Agent fixes → pushes → CI runs again ``` **Key patterns:** ``` Lint failure → Agent runs `golangci-lint run` locally and fixes the reported package Static analysis error → Agent reads the `go vet` output and fixes the cited code path Test failure → Agent follows debugging-and-error-recovery skill Build error → Agent checks go.mod, package paths, and build tags ``` ## Deployment Strategies ### Preview Deployments Every PR gets a preview deployment for manual testing: ```yaml # Build a preview artifact on PR deploy-preview: runs-on: ubuntu-latest if: github.event_name == 'pull_request' steps: - uses: actions/checkout@v4 - uses: actions/setup-go@v5 with: go-version-file: go.mod cache: true - run: go mod download - name: Build preview binary run: go build -o dist/app-preview ./... ``` ### Feature Flags Feature flags decouple deployment from release. Deploy incomplete or risky features behind flags so you can: - **Ship code without enabling it.** Merge to main early, enable when ready. - **Roll back without redeploying.** Disable the flag instead of reverting code. - **Canary new features.** Enable for 1% of users, then 10%, then 100%. - **Run A/B tests.** Compare behavior with and without the feature. ```go // Simple feature flag pattern. if cfg.Features.NewCheckoutFlow { return renderNewCheckout(ctx, request) } return renderLegacyCheckout(ctx, request) ``` **Flag lifecycle:** Create → Enable for testing → Canary → Full rollout → Remove the flag and dead code. Flags that live forever become technical debt — set a cleanup date when you create them. ### Staged Rollouts ``` PR merged to main │ ▼ Staging deployment (auto) │ Manual verification ▼ Production deployment (manual trigger or auto after staging) │ ▼ Monitor for errors (15-minute window) │ ├── Errors detected → Rollback └── Clean → Done ``` ### Rollback Plan Every deployment should be reversible: ```yaml # Manual rollback workflow name: Rollback on: workflow_dispatch: inputs: version: description: 'Version to rollback to' required: true jobs: rollback: runs-on: ubuntu-latest steps: - name: Rollback deployment run: | # Deploy the specified previous version ./scripts/rollback.sh ${{ inputs.version }} ``` ## Environment Management ``` .env.example → Committed (template for developers) .env → NOT committed (local development) .env.test → Committed (test environment, no real secrets) CI secrets → Stored in GitHub Secrets / vault Production secrets → Stored in deployment platform / vault ``` CI should never have production secrets. Use separate secrets for CI testing. ## Automation Beyond CI ### Dependabot / Renovate ```yaml # .github/dependabot.yml version: 2 updates: - package-ecosystem: gomod directory: / schedule: interval: weekly open-pull-requests-limit: 5 ``` ### Build Cop Role Designate someone responsible for keeping CI green. When the build breaks, the Build Cop's job is to fix or revert — not the person whose change caused the break. This prevents broken builds from accumulating while everyone assumes someone else will fix it. ### PR Checks - **Required reviews:** At least 1 approval before merge - **Required status checks:** CI must pass before merge - **Branch protection:** No force-pushes to main - **Auto-merge:** If all checks pass and approved, merge automatically ## CI Optimization When the pipeline exceeds 10 minutes, apply these strategies in order of impact: ``` Slow CI pipeline? ├── Cache dependencies │ └── Use setup-go cache or actions/cache for the module and build cache ├── Run jobs in parallel │ └── Split lint, vet, test, and build into separate parallel jobs ├── Only run what changed │ └── Use path filters to skip unrelated jobs (e.g., skip integration for docs-only PRs) ├── Use matrix builds │ └── Shard test suites across multiple runners ├── Optimize the test suite │ └── Remove slow tests from the critical path, run them on a schedule instead └── Use larger runners └── GitHub-hosted larger runners or self-hosted for CPU-heavy builds ``` **Example: caching and parallelism** ```yaml jobs: lint: runs-on: ubuntu-latest steps: - uses: actions/checkout@v4 - uses: actions/setup-go@v5 with: go-version-file: go.mod cache: true - run: go mod download - run: golangci-lint run vet: runs-on: ubuntu-latest steps: - uses: actions/checkout@v4 - uses: actions/setup-go@v5 with: go-version-file: go.mod cache: true - run: go mod download - run: go vet ./... test: runs-on: ubuntu-latest steps: - uses: actions/checkout@v4 - uses: actions/setup-go@v5 with: go-version-file: go.mod cache: true - run: go mod download - run: go test ./... -cover ``` ## Common Rationalizations | Rationalization | Reality | |---|---| | "CI is too slow" | Optimize the pipeline (see CI Optimization below), don't skip it. A 5-minute pipeline prevents hours of debugging. | | "This change is trivial, skip CI" | Trivial changes break builds. CI is fast for trivial changes anyway. | | "The test is flaky, just re-run" | Flaky tests mask real bugs and waste everyone's time. Fix the flakiness. | | "We'll add CI later" | Projects without CI accumulate broken states. Set it up on day one. | | "Manual testing is enough" | Manual testing doesn't scale and isn't repeatable. Automate what you can. | ## Red Flags - No CI pipeline in the project - CI failures ignored or silenced - Tests disabled in CI to make the pipeline pass - Production deploys without staging verification - No rollback mechanism - Secrets stored in code or CI config files (not secrets manager) - Long CI times with no optimization effort ## Verification After setting up or modifying CI: - [ ] All quality gates are present (lint, static analysis, tests, build, audit) - [ ] Pipeline runs on every PR and push to main - [ ] Failures block merge (branch protection configured) - [ ] CI results feed back into the development loop - [ ] Secrets are stored in the secrets manager, not in code - [ ] Deployment has a rollback mechanism - [ ] Pipeline runs in under 10 minutes for the test suite --- > Source: [tarotclub/go-tpl](https://github.com/tarotclub/go-tpl) — distributed by [TomeVault](https://tomevault.io).