pedroct Data Pipeline Ops
Steps
- Define sources, sinks, and transformations.
- Design idempotency and backfills.
- Choose scheduling and orchestration.
- Add data quality checks.
- Ensure lineage and observability.
Data Pipeline Ops by pedroct · 48d2a31
npx skillmds@latest add pedroct/data-pipeline-ops File contents
---name: data-pipeline-opsdescription: Design and operate data pipelines.---# Data Pipeline Ops## Steps1. Define sources, sinks, and transformations.2. Design idempotency and backfills.3. Choose scheduling and orchestration.4. Add data quality checks.5. Ensure lineage and observability.
pedroct/treit-kit-agentes/tree/main/templates/base/.agents/skills/data-pipeline-ops commit 48d2a31a27
Frequently asked questions
Run npx skillmds@latest add pedroct/data-pipeline-ops in your terminal (requires Node.js), paste this page's agent-chat prompt into Claude, Cursor, or any MCP-connected agent, or download the SKILL.md file and copy it into your agent's skills directory.
Design and operate data pipelines. It is listed under DevOps & Infra on SkillMD.
This skill has not completed SkillMD's automated safety review yet. SkillMD never runs a skill's scripts for you; review the SKILL.md before installing.
This skill is tagged as working with Claude Code, Claude.ai, OpenAI Codex. SKILL.md is an open format, so most agents that read a skills directory can load it too.
Yes. Installing skills from SkillMD is free, and the skill stays under its author's original license.
pedroct (@pedroct) published this skill. Their other Agent Skills are listed on their SkillMD profile.