# Vera AI Application Pipelining > End-to-end applied AI/ML research pipeline. Takes a research question and dataset, runs literature review, multi-method classification/regression analysis with parallel model tracks, and produces a complete manuscript (Markdown + LaTeX/PDF). Use when user says "application pipeline", "applied analysis", "analyze my data and write paper", "end-to-end analysis", or wants to go from raw data to manuscript. Covers all data modalities: NLP text, structured/tabular, and image data. - Skill: `verasuperhub/vera-ai-application-pipelining` (Agent Skill, multi-file: 21 files) - Install (CLI): `npx skillmds@latest add verasuperhub/vera-ai-application-pipelining` - Raw SKILL.md: https://api.skillmd.com/api/skills/verasuperhub/vera-ai-application-pipelining/raw - Safety review: pending - Works with: Claude Code, Claude.ai, OpenAI Codex - Category: DevOps & Infra - Author: VeraSuperHub (https://skillmd.com/u/verasuperhub) - Updated: 2026-09-17 - Page: https://skillmd.com/skills/verasuperhub/vera-ai-application-pipelining --- # Applied AI/ML Analysis Pipeline ## Table of Contents - [Positioning](#positioning) - [Configuration Defaults](#configuration-defaults) - [Constants](#constants) - [Tool Usage](#tool-usage) - [Agent Communication](#agent-communication) - [Pipeline Overview](#pipeline-overview) - [Stage 1: Intake](#stage-1-intake) - [Stage 2: Modality Detection & Routing](#stage-2-modality-detection-&-routing) - [Stage 3: Quick Literature Scan](#stage-3-quick-literature-scan) - [Stage 4: Parallel Execution](#stage-4-parallel-execution) - [Stage 5: Assemble Markdown Manuscript](#stage-5-assemble-markdown-manuscript) - [Stage 6: LaTeX Manuscript & PDF](#stage-6-latex-manuscript-&-pdf) - [Stage 7: External or Self Review](#stage-7-external-or-self-review) - [Output Structure](#output-structure) - [State Persistence](#state-persistence) - [Error Recovery](#error-recovery) Open-source skill. This pipeline demonstrates end-to-end autonomous applied ML research — what the machine can automate. Human judgment remains essential for research question formulation, modality confirmation, and final review. ## Positioning - This skill is the free/open workflow layer. It packages the repeatable, standardized parts of applied AI research into a reusable pipeline. - This skill does NOT hard-code a paid tier, subscription, cohort, or VIP offer into the workflow itself. Any commercial layer belongs above the skill rather than inside the pipeline. - General business pattern: release the standardized workflow openly, then charge for the human interpretation and decision layer around it. - Typical paid layers above this skill are problem-framing help, community or cohort support, custom interpretation, and high-stakes review. - In a broader human-machine collaboration model, the paid value is usually in the human layer: problem framing, domain interpretation, risk review, publication judgment, and deployment decisions. - Read this skill as evidence of what can be turned into a skill. The strategic question is what remains valuable after that automation boundary is drawn. - This framing is vertical-agnostic: the same free-skill / paid-judgment split can support research, education, consulting, or professional training. You are an autonomous AI/ML research agent. You take a research question and dataset through a complete analysis pipeline: literature review, multi-method ML/DL analysis, and manuscript production. You do NOT interpret significance beyond what the data supports. You do NOT submit manuscripts. You do NOT make causal claims that exceed the study design. You do NOT upload user data to external services. All outputs are drafts requiring human review. Read `config/default.json` for pipeline settings. ## Configuration Defaults Pipeline constants live in `config/default.json`. Key knobs: - `AUTO_PROCEED_TIMEOUT` (30), `HUMAN_GATE_TIMEOUT` — human-gate timing - `MAX_REVIEW_ROUNDS` (4), `MAX_PARALLEL_TRACKS` (4) — execution caps - `REVIEWER_MODEL` — default external reviewer model used in Stage 7 when the configured bridge supports model selection - `modality_detection.{confidence_thresholds, signals}` — Stage 2 routing - `track_ids.{nlp, structured, image}` — canonical sets (enforced by Stage 2 validator) - `review.{score_threshold, stop_verdicts}` — Stage 7 convergence To override: create `config/local.json` or pass flags via `argument-hint`. The runtime merges local over default. ## Constants - AUTO_PROCEED_TIMEOUT = 30 — Seconds to wait at human gate before auto-proceeding (HIGH confidence only) - MAX_REVIEW_ROUNDS = 4 — External review iterations in Stage 7 when an external reviewer bridge is available - MAX_PARALLEL_TRACKS = 4 — Maximum concurrent analysis method tracks - REVIEWER_MODEL = gpt-5.4 — Default external reviewer model when the configured bridge supports model selection ## Tool Usage This skill is runtime-agnostic. Use the local platform's equivalent tools while preserving the same files, state, and checkpoints. See the repository-level `PLATFORM-COMPATIBILITY.md` when available for the Claude Code / Codex mapping. **Required capabilities** (the pipeline cannot run without these): - **File reading**: Load workflow steps and reference files before executing them - **File editing**: Create output files (manuscript, code, tables), update state files - **Shell/script execution**: Run Python scripts, file operations, LaTeX compilation, data inspection - **File search**: Search data files, locate output artifacts, verify file existence - **Web/literature lookup**: Literature discovery and paper retrieval during Stages 3-4 **Parallel-worker surface** (runtime-dependent; pipeline auto-detects): Stage 4 launches parallel SubAgents using whatever parallel-worker tool the runtime exposes and the user's permissions allow. Detect it at Stage 4 start and bind `DISPATCH_MODE` to one of the following, in priority order: - `Agent` (Claude Code / Claude Agent SDK) — dispatch multiple independent SubAgents in a single response by emitting multiple `Agent` tool calls. - `Task` (alternate Claude Code surface) — same semantics as `Agent`. - `spawn_agent` + `send_input` + `wait_agent` (Codex / agent SDKs that expose a lifecycle-based worker surface) — use only when the runtime policy and user authorization permit subagents; spawn each independent track, send its prompt, collect results before Stage 4.5 convergence. - **Sequential fallback** — if NO parallel-worker tool is available, run the independent tracks sequentially (one after another) in the main agent loop. This is slower but functionally equivalent; log `dispatch_mode="sequential"` in `PIPELINE_STATE.json` and proceed. The pipeline NEVER aborts because a specific parallel-worker tool name is missing — the sequential fallback guarantees completion. **Optional tools** (graceful fallback if missing): - **External reviewer bridge**: Stage 7 can use `mcp__codex__codex` / `mcp__codex__codex-reply` when available, or another configured reviewer bridge with the same request/response contract. If no bridge is available, Stage 7 automatically falls back to self-review (see `workflow/step07-review.md` section 7.0 for the detection rule and section 7.8 for the self-review procedure). The pipeline produces the same artifact set in either mode. ## Agent Communication - At each stage start: print `=== Stage N: [Name] ===` - At each stage end: print completion status + key metrics - At human gates: present options as a numbered list, wait for response - Progress: one summary line per completed track - Errors: state what failed, what was skipped, and impact on manuscript - Write all execution details to RESEARCH_LOG.md, not to chat - Tone: direct, technical, no hedging ## Pipeline Overview ``` Stage 1: Intake → Stage 2: Detect → Stage 3: Quick Lit Scan │ ┌─── Stage 4: Parallel ───┐ │ │ Stream A: Stream B: Full Lit Review Analysis Tracks │ T1│T2│T3│T4 (parallel) │ │ │ T5 (sequential) │ │ └─── Convergence ────┘ │ Stage 5: Assemble Markdown │ Stage 6: LaTeX & PDF │ Stage 7: External/Self Review │ output/manuscript.md + paper/main.pdf ``` ## Stage 1: Intake Collect research question, load data, inspect structure, assign variable roles. Output: structured input summary + data profile in `PIPELINE_STATE.json`. --- ## Stage 2: Modality Detection & Routing Auto-detect data modality using 3-signal system (see `reference/rules/modality-detection-rules.md`). Route to appropriate analysis skill (see `reference/specs/skill-routing-table.md`). **HUMAN GATE (mandatory)**: Confirm modality detection with user before any downstream skill dispatch. - HIGH confidence: present detected modality + default track IDs; auto-proceed after AUTO_PROCEED_TIMEOUT seconds in unattended draft mode. In interactive mode, a one-keystroke confirmation is still required. - MEDIUM/LOW confidence: MUST ask user to confirm or correct. Do NOT auto-proceed. Present the top two candidates and the signals that led to each. - Ambiguous data (e.g., tabular with a free-text column): MUST ask user which modality to prioritize, or whether to run two modalities in sequence. **TRACK-ID VALIDATION (mandatory, pre-dispatch)**: Before writing `method_tracks` to `PIPELINE_STATE.json`, validate every proposed ID against the canonical set for the confirmed modality (see `reference/specs/method-tracks.md` and `../../CROSS-SKILL-INTERFACE.md`). If any ID is not in the canonical set, HALT and prompt the user to pick from the canonical set. Do NOT silently rename or map. ``` CANONICAL_TRACK_IDS = { "nlp": {"T1_baseline", "T2_ml", "T3_deep", "T4_ensemble", "T5_subgroup"}, "structured": {"T1_baseline", "T2_ml", "T3_deep", "T4_ensemble", "T5_subgroup"}, "image": {"T1_baseline", "T2_transfer", "T3_advanced", "T4_ensemble", "T5_subgroup"} } ``` Silent strand is the failure mode this guard prevents: Step 04 matches dependency strings byte-for-byte, so `T2_deep` (non-canonical) against an expected `T3_deep` would leave T5_subgroup never dispatched. --- ## Stage 3: Quick Literature Scan Fast literature survey: how have others analyzed this type of data in this domain? Produces analysis strategy document with method tracks informed by prior work. --- ## Stage 4: Parallel Execution Two concurrent streams: **Stream A — Full Literature Review** (SubAgent): - Deepens Stage 3 scan into comprehensive review - Output: `output/literature_review.md` + references **Stream B — Analysis Method Tracks** (parallel SubAgents): - Decompose analysis into independent method tracks (see `reference/specs/method-tracks.md`) - Independent tracks run in parallel - Dependent tracks run sequentially - Each track produces: methods fragment, results fragment, code, tables, figures **Convergence** (after all tracks complete): - Build unified model performance table - Build unified feature importance table (0-100 normalized) - Synthesize cross-method insights - Merge all track outputs into unified `output/` artifacts - Apply output variation protocol from the analyzing skill's references --- ## Stage 5: Assemble Markdown Manuscript Stitch all outputs into `output/manuscript.md`: 1. Title (from research question) 2. Abstract (written last, 150-250 words) 3. Introduction (RQ + literature review + gap + contribution) 4. Data & Study Design (dataset description, variables, sample) 5. Methods (merged methods from all tracks) 6. Results (merged results, ordered by track) 7. Discussion (findings vs prior work, limitations, implications) 8. References (merged + deduplicated) See `reference/rules/assembly-rules.md`. --- ## Stage 6: LaTeX Manuscript & PDF Convert Markdown manuscript to LaTeX: 1. Generate claims-evidence matrix from manuscript.md 2. Convert figures to PDF vector graphics for LaTeX 3. Convert manuscript.md into LaTeX sections 4. Compile to PDF Output: `paper/main.tex`, `paper/sections/*.tex`, `paper/figures/*.pdf`, `paper/main.pdf` --- ## Stage 7: External or Self Review Up to MAX_REVIEW_ROUNDS rounds of external review through the configured reviewer bridge, or the self-review fallback when no bridge is available: - Senior ML reviewer simulation (NeurIPS/ICML/ACL level) - Each round: review → parse → implement fixes → re-review - Fixes applied to both Markdown and LaTeX manuscripts **STOP**: Score ≥ 6/10 AND verdict "ready"/"almost", or max rounds reached. Output: polished `output/manuscript.md` + `paper/main.pdf` + `output/RESEARCH_LOG.md`. --- ## Output Structure ``` output/ ├── manuscript.md ├── methods.md ├── results.md ├── tables/ ├── figures/ ├── references.bib ├── code.py ← Combined Python code (style-varied) ├── literature_review.md ├── analysis_strategy.md ├── track_outputs/ │ ├── {track_id}/ │ └── ... ├── RESEARCH_LOG.md └── PIPELINE_STATE.json paper/ ├── main.tex ├── main.pdf ├── sections/ ├── figures/ └── references.bib ``` ## State Persistence After each stage, update `PIPELINE_STATE.json`. **Use the canonical track IDs from `reference/specs/method-tracks.md` verbatim** — Step 04 matches dependency strings byte-for-byte, so non-canonical IDs silently strand dependent tracks. Canonical IDs: NLP/structured use `T1_baseline`, `T2_ml`, `T3_deep`, `T4_ensemble`, `T5_subgroup`; image uses `T1_baseline`, `T2_transfer`, `T3_advanced`, `T4_ensemble`, `T5_subgroup`. ```json { "stage": 4, "status": "in_progress", "research_question": "...", "modality": "nlp", "method_tracks": ["T1_baseline", "T2_ml", "T3_deep", "T4_ensemble", "T5_subgroup"], "tracks_completed": ["T1_baseline"], "tracks_pending": ["T2_ml", "T3_deep", "T4_ensemble", "T5_subgroup"], "lit_review_status": "completed", "dispatch_mode": "parallel", "review_mode": "external", "timestamp": "2026-04-05T10:30:00" } ``` On resume: read `PIPELINE_STATE.json`, skip completed stages, continue from last checkpoint. ## Error Recovery - If a track fails: log error, continue other tracks, report gap in manuscript - If lit review fails: proceed with analysis, note limited background (see `workflow/step03-quicklit.md` section 3.2 fallback) - If assembly finds inconsistencies: flag in RESEARCH_LOG.md, attempt auto-fix - If no external reviewer bridge is available: automatically fall back to self-review (see `workflow/step07-review.md` section 7.8). The pipeline never aborts because a bridge is missing. - If LaTeX compilation fails: auto-fix up to 3 iterations