Hcpya Skill

HCP-YA Skill (Dataset-Orchestration Layer)

Overview

hcpya-skill is the NeuroClaw orchestration skill for the HCP Young Adult (HCP-YA / HCP1200) dataset.

It strictly follows the NeuroClaw hierarchical design principles:

• This skill only describes WHAT needs to be done and which tool skill to delegate to.
• It contains no implementation code or concrete commands.
• All concrete execution is delegated to existing base/tool skills via claw-shell.
• Companion scripts in scripts/ provide reference implementations for data reorganization, phenotype extraction, and QC.

Core workflow (never bypassed):

1. Identify input HCP-YA data and target modalities.
2. Generate a numbered execution plan clearly stating WHAT needs to be done and which tool skill will handle each step.
3. Present the full plan, estimated runtime, resource requirements, and risks to the user and wait for explicit confirmation ("YES" / "execute" / "proceed").
4. On confirmation, delegate every step to the appropriate skill via claw-shell.
5. After execution, save all outputs in a clean directory structure (hcpya_output/).

Research use only.

Quick Reference

Download Stage (Mandatory First Step)

Source

HCP-YA data is distributed through ConnectomeDB:

• Website: https://db.humanconnectome.org/
• Requires ConnectomeDB account and data use agreement
• NeuroSTORM download scripts available at: https://github.com/CUHK-AIM-Group/NeuroSTORM/tree/main/scripts/dataset_download

Supported Download Entry Scripts

• download_HCP_1200_all.py (all modalities)
• download_HCP_1200_rfMRI.py (resting-state fMRI)
• download_HCP_1200_tfMRI.py (task fMRI)
• download_HCP_1200_t1t2.py (structural T1w/T2w)
• all_pid.pkl (subject list metadata)

Download Inputs to Confirm in Plan

• ConnectomeDB credentials/token
• Target subset (all, rfMRI, tfMRI, t1t2)
• Subject list scope (full 1,200 or custom subset)
• Destination directory with sufficient disk space (~80 TB for full dataset)

HCP-YA Task Paradigms

BIDS Preparation

Script: scripts/reorganize_hcpya.py

Converts HCP-YA native directory structure to BIDS-compliant layout.

python skills/hcpya-skill/scripts/reorganize_hcpya.py \
  --input /path/to/HCPYA/raw \
  --output /path/to/HCPYA/bids \
  --participants /path/to/subject_list.txt

Features:

• Subject ID normalization: HCP format (100307) to BIDS (sub-100307)
• Modality routing: T1w, T2w, dMRI, rs-fMRI, task-fMRI (7 tasks)
• Sidecar JSON generation from HCP metadata
• dataset_description.json and participants.tsv generation
• Dry-run mode: --dry-run to preview without copying

Core Workflow (Never Bypassed)

1. Identify user target: full HCP-YA processing, imaging subset, phenotype extraction, or BIDS staging only.
2. Generate a numbered plan with tools, outputs, runtime, storage, and risks.
3. Wait for explicit confirmation (YES / execute / proceed).
4. On confirmation, run download stage first (if needed).
5. After download success, run BIDS preparation using scripts/reorganize_hcpya.py.
6. Delegate to smri-skill for structural MRI processing.
7. Delegate to fmri-skill for functional MRI processing.
8. Delegate to dwi-skill for diffusion MRI processing.
9. If phenotype extraction is requested, run scripts/extract_hcpya_phenotype.py.
10. If QC summary is requested, run scripts/hcpya_qc_summary.py.
11. Save outputs into hcpya_output/.

Modality Processing Delegation

Standard Output Layout

hcpya_output/
├── raw/                    # Downloaded original HCP-YA files
├── bids/                   # BIDS-staged data
├── smri/                   # Structural MRI derivatives
├── fmri/                   # Functional MRI derivatives
├── dwi/                    # Diffusion MRI derivatives
├── phenotype/              # Merged phenotype tables
├── qc/                     # QC summaries and exclusion lists
└── logs/                   # Download + orchestration logs

Benchmark Adapter Guidance

For benchmark-style prompts, do not force the full download -> staging -> multimodal processing orchestration when the task only asks for local HCP-YA data staging or organization.

• If the task starts from raw HCP-YA data already present on disk and only asks for BIDS-style staging:
  • Skip the mandatory download stage
  • Default to the narrow path local raw HCP-YA discovery -> BIDS-style staging -> minimal metadata -> validation/report
• In benchmark mode, do not require explicit confirmation before presenting the direct staging solution.
• Only use the full multimodal orchestration when the prompt explicitly asks for download or end-to-end processing.

Safety and Execution Policy

• No execution before explicit plan confirmation.
• All execution must be routed via claw-shell.
• Missing dependencies must be resolved by dependency-planner before running.
• If download fails for partial subjects, continue batch with clear failure report and retry list.

Important Notes and Limitations

• HCP-YA processing is resource intensive (CPU, RAM, and storage).
• Full HCP-YA dataset is ~80 TB; plan storage accordingly.
• HCP-YA has 1,200 subjects with complete multimodal data.
• Age range: 22-35 years.
• For HCP-native preprocessing (minimal preprocessing pipelines), optionally delegate to hcppipeline-tool.
• hcpya-skill is orchestration-only; detailed preprocessing logic remains in modality skills.

When to Call This Skill

• User asks for end-to-end HCP Young Adult workflow.
• User asks to download HCP1200 and run sMRI/fMRI/DTI processing.
• User needs BIDS staging for HCP-YA data.
• User asks to extract HCP-YA phenotype data (cognitive, behavioral, demographic).

Complementary / Related Skills

• smri-skill → structural MRI preprocessing
• fmri-skill → functional MRI preprocessing and analysis
• dwi-skill → diffusion MRI preprocessing and analysis
• hcppipeline-tool → HCP-native minimal preprocessing pipelines
• bids-organizer → BIDS validation and organization
• brain-visualization → visualization of derivatives
• dependency-planner → dependency resolution
• conda-env-manager → environment management
• claw-shell → command execution

Reference

• HCP-YA: https://www.humanconnectome.org/study/hcp-young-adult
• ConnectomeDB: https://db.humanconnectome.org/
• NeuroSTORM download scripts: https://github.com/CUHK-AIM-Group/NeuroSTORM/tree/main/scripts/dataset_download
• Glasser et al. (2013): The Human Connectome Project minimally preprocessed pipelines

Created At: 2026-05-06 13:02 HKT Last Updated At: 2026-05-06 13:02 HKT Author: chengwang96