# Bio Prefect Dask Nextflow

> Design and scaffold bioinformatics pipelines using Prefect+Dask for local/distributed execution or Nextflow for HPC schedulers. Use when this capability is needed.

- Skill: `tomevault-io/bio-prefect-dask-nextflow` (Agent Skill, multi-file: 2 files)
- Install (CLI): `npx skillmds@latest add tomevault-io/bio-prefect-dask-nextflow`
- Raw SKILL.md: https://api.skillmd.com/api/skills/tomevault-io/bio-prefect-dask-nextflow/raw
- Safety review: pending (external: skill-scanner PASS, skillspector PASS)
- Works with: Claude Code, Claude.ai, OpenAI Codex
- Category: Coding & Dev Tools
- Author: tomevault-io (https://skillmd.com/u/tomevault-io)
- Updated: 2026-09-17
- Page: https://skillmd.com/skills/tomevault-io/bio-prefect-dask-nextflow

---


# Bio Prefect + Dask + Nextflow

Choose and scaffold the right workflow engine for local, distributed, or HPC bioinformatics pipelines.

## Instructions

1. Collect requirements (scheduler, container policy, data location, scale).
2. Choose engine: Prefect+Dask, Nextflow, or Hybrid.
3. Generate a runnable scaffold with clear data layout and resources.
4. Validate with a small test and resume/retry checks.

## Quick Reference

| Task | Action |
|------|--------|
| Engine choice | See `decision-matrix.md` |
| Prefect+Dask scaffold | See `prefect-dask.md` |
| Prefect on Slurm | See `prefect-hpc-slurm.md` |
| Nextflow on HPC | See `nextflow-hpc.md` |
| Examples | See `examples.md` |

## Input Requirements

- Workflow requirements and steps
- Target environment (local, cluster, cloud)
- Scheduler and container constraints
- Data locations and expected volumes

## Output

- Engine recommendation with rationale
- Runnable scaffold (files + commands)
- Resource plan per step
- Validation plan and checkpoints

## Quality Gates

- [ ] Tiny test run completes end-to-end
- [ ] Resume/retry behavior verified
- [ ] Resource plan matches cluster limits

## Examples

### Example 1: Engine recommendation

```text
Choice: Nextflow
Why: CLI-heavy pipeline, HPC scheduler required, reproducible cache/resume needed.
```

## Troubleshooting

**Issue**: Workflow fails on HPC due to environment mismatch
**Solution**: Pin container/conda versions and validate with a minimal test dataset.

---
> Converted and distributed by [TomeVault](https://tomevault.io/claim/fmschulz) — claim your Tome and manage your conversions.
<!-- tomevault:4.0:skill_md:2026-04-14 -->