Building CI/CD Pipelines
Current State
!ls .github/workflows/*.yml .gitlab-ci.yml Jenkinsfile .circleci/config.yml 2>/dev/null || echo 'No CI/CD config found'
Overview
Generate CI/CD pipeline configurations for GitHub Actions, GitLab CI, Jenkins, CircleCI, and Azure DevOps. Produce multi-stage workflows covering linting, testing, building container images, security scanning, and deploying to staging/production with proper gating and rollback mechanisms.
Prerequisites
- Git repository hosted on a supported platform (GitHub, GitLab, Bitbucket, Azure DevOps)
- Container runtime (Docker) if building images
- Target deployment environment credentials configured as pipeline secrets
- Test suite that can run headlessly (
npm test, pytest, go test, etc.)
- Understanding of branching strategy (trunk-based, GitFlow, or environment branches)
Instructions
- Scan the project for existing CI/CD configuration files (
.github/workflows/, .gitlab-ci.yml, Jenkinsfile, .circleci/config.yml)
- Identify the application stack: language, framework, test runner, package manager, and deployment target
- Define pipeline stages:
lint -> test -> build -> security-scan -> deploy-staging -> integration-test -> deploy-production
- Generate the pipeline configuration file with appropriate triggers (push to main, PR events, tags)
- Add caching for dependencies (
node_modules, .pip-cache, Go modules) to reduce build times
- Configure matrix builds for multiple language versions or OS targets where appropriate
- Add secret references for deployment credentials, container registry tokens, and API keys (never hardcode)
- Implement deployment gates: manual approval for production, automated rollback on health check failure
- Add status badges and notifications (Slack, email) for build results
- Validate the pipeline syntax using platform-specific tools (
actionlint, gitlab-ci-lint)
Output
- Pipeline configuration files (
.github/workflows/*.yml, .gitlab-ci.yml, Jenkinsfile)
- Dockerfile for container builds (multi-stage, minimal base image)
- Deployment scripts or Kubernetes manifests referenced by the pipeline
- Environment-specific variable files for staging vs. production
Error Handling
| Error |
Cause |
Solution |
Pipeline triggered but no jobs run |
Trigger conditions (paths, branches) do not match |
Review on: / only: / rules: filters and verify branch names |
Docker build failed: layer cache miss |
Cache key changed or cache storage expired |
Use content-based cache keys (hashFiles('**/package-lock.json')) and verify cache backend |
Secret not found |
Secret name mismatch or not set in pipeline settings |
Check secret names match exactly (case-sensitive) in repository/project settings |
Deploy failed: unauthorized |
Expired or incorrect deployment credentials |
Rotate credentials, update pipeline secrets, and verify IAM role/service account permissions |
Tests pass locally but fail in CI |
Environment differences (OS, node version, timezone) |
Pin runtime versions in pipeline config; use matrix to test across environments |
Examples
- "Create a GitHub Actions workflow for a Node.js app: lint with ESLint, test with Jest, build Docker image, push to ECR, deploy to EKS staging on PR merge."
- "Generate a GitLab CI pipeline with parallel test jobs, SAST scanning, and manual production deployment gate."
- "Build a Jenkins pipeline that runs Python tests in a Docker agent, publishes coverage to SonarQube, and deploys via Terraform."
Resources
1---2name: building-cicd-pipelines-23description: Execute use when you need to work with deployment and CI/CD. This skill provides deployment automation and pipeline orchestration with comprehensive guidance and automation. Trigger with phrases like "deploy application", "create pipeline", or "automate deployment".4license: MIT5---6# Building CI/CD Pipelines
7
8## Current State
9!`ls .github/workflows/*.yml .gitlab-ci.yml Jenkinsfile .circleci/config.yml 2>/dev/null || echo 'No CI/CD config found'`
10
11## Overview
12
13Generate CI/CD pipeline configurations for GitHub Actions, GitLab CI, Jenkins, CircleCI, and Azure DevOps. Produce multi-stage workflows covering linting, testing, building container images, security scanning, and deploying to staging/production with proper gating and rollback mechanisms.
14
15## Prerequisites
16
17- Git repository hosted on a supported platform (GitHub, GitLab, Bitbucket, Azure DevOps)
18- Container runtime (Docker) if building images
19- Target deployment environment credentials configured as pipeline secrets
20- Test suite that can run headlessly (`npm test`, `pytest`, `go test`, etc.)
21- Understanding of branching strategy (trunk-based, GitFlow, or environment branches)
22
23## Instructions
24
251. Scan the project for existing CI/CD configuration files (`.github/workflows/`, `.gitlab-ci.yml`, `Jenkinsfile`, `.circleci/config.yml`)
262. Identify the application stack: language, framework, test runner, package manager, and deployment target
273. Define pipeline stages: `lint` -> `test` -> `build` -> `security-scan` -> `deploy-staging` -> `integration-test` -> `deploy-production`
284. Generate the pipeline configuration file with appropriate triggers (push to main, PR events, tags)
295. Add caching for dependencies (`node_modules`, `.pip-cache`, Go modules) to reduce build times
306. Configure matrix builds for multiple language versions or OS targets where appropriate
317. Add secret references for deployment credentials, container registry tokens, and API keys (never hardcode)
328. Implement deployment gates: manual approval for production, automated rollback on health check failure
339. Add status badges and notifications (Slack, email) for build results
3410. Validate the pipeline syntax using platform-specific tools (`actionlint`, `gitlab-ci-lint`)
35
36## Output
37
38- Pipeline configuration files (`.github/workflows/*.yml`, `.gitlab-ci.yml`, `Jenkinsfile`)
39- Dockerfile for container builds (multi-stage, minimal base image)
40- Deployment scripts or Kubernetes manifests referenced by the pipeline
41- Environment-specific variable files for staging vs. production
42
43## Error Handling
44
45| Error | Cause | Solution |
46|-------|-------|---------|
47| `Pipeline triggered but no jobs run` | Trigger conditions (paths, branches) do not match | Review `on:` / `only:` / `rules:` filters and verify branch names |
48| `Docker build failed: layer cache miss` | Cache key changed or cache storage expired | Use content-based cache keys (`hashFiles('**/package-lock.json')`) and verify cache backend |
49| `Secret not found` | Secret name mismatch or not set in pipeline settings | Check secret names match exactly (case-sensitive) in repository/project settings |
50| `Deploy failed: unauthorized` | Expired or incorrect deployment credentials | Rotate credentials, update pipeline secrets, and verify IAM role/service account permissions |
51| `Tests pass locally but fail in CI` | Environment differences (OS, node version, timezone) | Pin runtime versions in pipeline config; use `matrix` to test across environments |
52
53## Examples
54
55- "Create a GitHub Actions workflow for a Node.js app: lint with ESLint, test with Jest, build Docker image, push to ECR, deploy to EKS staging on PR merge."
56- "Generate a GitLab CI pipeline with parallel test jobs, SAST scanning, and manual production deployment gate."
57- "Build a Jenkins pipeline that runs Python tests in a Docker agent, publishes coverage to SonarQube, and deploys via Terraform."
58
59## Resources
60
61- GitHub Actions: https://docs.github.com/en/actions
62- GitLab CI/CD: https://docs.gitlab.com/ee/ci/
63- Jenkins Pipeline: https://www.jenkins.io/doc/book/pipeline/
64- CI/CD best practices: https://martinfowler.com/articles/continuousIntegration.html
jeremylongshore