Single-trajectory analysis skill
Overview
This skill describes how to reproduce and extend the single-trajectory analysis workflow in omicverse, combining graph-based trajectory inference, RNA velocity coupling, and downstream fate scoring notebooks.
Trajectory setup
- PAGA (Partition-based graph abstraction)
- Build a neighborhood graph (
pp.neighbors) on the preprocessed AnnData object.
- Use
tl.paga to compute cluster connectivity and tl.draw_graph or tl.umap with init_pos='paga' for embedding.
- Interpret edge weights to prioritize branch resolution and seed paths.
- Palantir
- Run
Palantir on diffusion components, seeding with manually selected start cells (e.g., naïve T cells).
- Extract pseudotime, branch probabilities, and differentiation potential for subsequent overlays.
- VIA
- Execute
via.VIA on the kNN graph to identify lineage progression with automatic root selection or user-defined roots.
- Export terminal states and pseudotime for cross-validation against PAGA and Palantir results.
Velocity coupling (VIA + scVelo)
- Use
scv.pp.filter_and_normalize, scv.pp.moments, and scv.tl.velocity to generate velocity layers.
- Provide VIA with
adata.layers['velocity'] to refine lineage directionality (via.VIA(..., velocity_weight=...)).
- Compare VIA pseudotime with scVelo latent time (
scv.tl.latent_time) to validate directionality and root selection.
Advanced RNA Velocity Backends (ov.single.Velo)
OmicVerse provides a unified Velo class wrapping 4 velocity backends. Use this when you need more than basic scVelo:
Backend selection guide
| Backend |
Best for |
GPU? |
Prerequisites |
| scvelo |
Standard velocity analysis |
No |
spliced/unspliced layers |
| dynamo |
Kinetics modeling, vector fields |
No |
spliced/unspliced layers |
| latentvelo |
VAE-based, batch correction, complex dynamics |
Yes (torchdiffeq) |
celltype_key, batch_key optional |
| graphvelo |
Refinement layer on top of any backend |
No |
base velocity + connectivities |
Unified Velo pipeline
import omicverse as ov
velo = ov.single.Velo(adata)
# 1. Filter (scvelo backend) or preprocess (dynamo backend)
velo.filter_genes(min_shared_counts=20) # For scvelo
# velo.preprocess(recipe='monocle', n_neighbors=30, n_pcs=30) # For dynamo
# 2. Compute moments
velo.moments(backend='scvelo', n_pcs=30, n_neighbors=30)
# backend: 'scvelo' or 'dynamo'
# 3. Fit kinetic parameters
velo.dynamics(backend='scvelo')
# 4. Calculate velocity
velo.cal_velocity(method='scvelo')
# method: 'scvelo', 'dynamo', 'latentvelo', 'graphvelo'
# 5. Build velocity graph and project to embedding
velo.velocity_graph(basis='umap')
velo.velocity_embedding(basis='umap')
latentvelo specifics (deep learning velocity)
latentvelo uses a VAE + neural ODE to learn latent dynamics. It handles batch effects and complex trajectories better than classical scVelo:
velo.cal_velocity(
method='latentvelo',
celltype_key='cell_type', # Optional: AnnotVAE uses cell type info
batch_key='batch', # Optional: batch correction
velocity_key='velocity_S',
n_top_genes=2000,
latentvelo_VAE_kwargs={}, # Pass custom VAE hyperparameters
)
# Requires: pip install torchdiffeq
# Uses GPU if available, falls back to CPU
graphvelo specifics (refinement layer)
GraphVelo refines velocity estimates from any base method by leveraging the cell graph structure. Run it after scvelo or dynamo:
# First: compute base velocity with scvelo or dynamo
velo.cal_velocity(method='scvelo')
# Then: refine with graphvelo
velo.graphvelo(
xkey='Ms', # Spliced moments key
vkey='velocity_S', # Base velocity key to refine
basis_keys=['X_umap', 'X_pca'], # Project to multiple embeddings
gene_subset=None, # Optional: restrict to gene subset
)
Downstream fate scoring notebooks
- CellFateGenie: For pseudotime-associated gene discovery, use
search_skills('CellFateGenie fate genes') to load the dedicated CellFateGenie skill.
t_metacells.ipynb: Aggregate metacell trajectories for robustness checks and meta-state differential expression.
t_cytotrace.ipynb: Integrate CytoTRACE differentiation potential with velocity-informed lineages for maturation scoring.
Required preprocessing
- Quality control: remove low-quality cells/genes, apply doublet filtering.
- Normalization & log transformation (
sc.pp.normalize_total, sc.pp.log1p).
- Highly variable gene selection tailored to immune datasets (
sc.pp.highly_variable_genes).
- Batch correction if necessary (e.g.,
scvi-tools, bbknn).
- Compute PCA, neighbor graph, and embedding (UMAP/FA) used by all trajectory methods.
- For velocity: compute moments on the same neighbor graph before running VIA coupling.
Parameter tuning
- Neighbor graph
n_neighbors and n_pcs should be harmonized across PAGA, VIA, and Palantir to maintain consistency.
- In VIA, adjust
knn, too_big_factor, and root_user for datasets with uneven sampling.
- Palantir requires careful start cell selection; use marker genes and velocity arrows to confirm.
- For PAGA, tweak
threshold to control edge sparsity; ensure connected components reflect biological branches.
- Velocity estimation: compare
mode='stochastic' vs mode='dynamical' in scVelo; recalibrate if terminal states disagree with VIA.
Visualization and export
- Overlay PAGA edges on UMAP (
scv.pl.paga) and annotate branch labels.
- Plot Palantir pseudotime and branch probabilities on embeddings.
- Visualize VIA trajectories using
via.plot_fates and via.plot_scatter.
- Export pseudotime tables and fate probabilities to CSV for downstream notebooks.
- Save high-resolution figures (PNG/SVG) and notebook artifacts for reproducibility.
- Update notebooks with consistent color schemes and metadata columns before sharing.
Defensive Validation Patterns
# Before PAGA: verify neighbor graph exists
assert 'neighbors' in adata.uns, "Neighbor graph required. Run sc.pp.neighbors(adata) first."
# Before VIA velocity coupling: verify velocity layers exist
if 'velocity' not in adata.layers:
print("WARNING: velocity layer missing. Run scv.tl.velocity(adata) first for VIA coupling.")
assert 'spliced' in adata.layers and 'unspliced' in adata.layers, \
"Missing spliced/unspliced layers. Check loom/H5AD import preserved velocity layers."
# Before Palantir: verify PCA/diffusion components
assert 'X_pca' in adata.obsm, "PCA required. Run ov.pp.pca(adata) first."
Troubleshooting tips
- Missing velocity layers: re-run
scv.pp.moments and scv.tl.velocity ensuring adata.layers['spliced']/['unspliced'] exist; verify loom/H5AD import preserved layers.
- Disconnected PAGA graph: inspect neighbor graph or adjust
n_neighbors; confirm batch correction didn’t fragment the manifold.
- Palantir convergence issues: reduce diffusion components or reinitialize start cells; ensure no NaN values in data matrix.
- VIA terminal states unstable: increase iterations (
cluster_graph_pruning_iter), or provide manual terminal state hints based on marker expression.
- Notebook kernel memory errors: downsample cells or precompute summaries (metacells) before rerunning.
- latentvelo
ImportError: torchdiffeq: Install with pip install torchdiffeq. Required for neural ODE backend.
- graphvelo returns NaN velocities: Ensure base velocity (scvelo/dynamo) was computed first. graphvelo refines — it doesn't compute from scratch.
- dynamo
preprocess fails: dynamo expects spliced/unspliced layers. Verify with 'spliced' in adata.layers.
1---2name: single-trajectory-analysis3description: Trajectory & RNA velocity: PAGA, Palantir, VIA, dynamo, scVelo, latentvelo, graphvelo backends via ov.single.Velo. Pseudotime, stream plots.4---56# Single-trajectory analysis skill78## Overview9This skill describes how to reproduce and extend the single-trajectory analysis workflow in `omicverse`, combining graph-based trajectory inference, RNA velocity coupling, and downstream fate scoring notebooks.1011## Trajectory setup12- **PAGA (Partition-based graph abstraction)**13 - Build a neighborhood graph (`pp.neighbors`) on the preprocessed AnnData object.14 - Use `tl.paga` to compute cluster connectivity and `tl.draw_graph` or `tl.umap` with `init_pos='paga'` for embedding.15 - Interpret edge weights to prioritize branch resolution and seed paths.16- **Palantir**17 - Run `Palantir` on diffusion components, seeding with manually selected start cells (e.g., naïve T cells).18 - Extract pseudotime, branch probabilities, and differentiation potential for subsequent overlays.19- **VIA**20 - Execute `via.VIA` on the kNN graph to identify lineage progression with automatic root selection or user-defined roots.21 - Export terminal states and pseudotime for cross-validation against PAGA and Palantir results.2223## Velocity coupling (VIA + scVelo)24- Use `scv.pp.filter_and_normalize`, `scv.pp.moments`, and `scv.tl.velocity` to generate velocity layers.25- Provide VIA with `adata.layers['velocity']` to refine lineage directionality (`via.VIA(..., velocity_weight=...)`).26- Compare VIA pseudotime with scVelo latent time (`scv.tl.latent_time`) to validate directionality and root selection.2728## Advanced RNA Velocity Backends (ov.single.Velo)2930OmicVerse provides a unified `Velo` class wrapping 4 velocity backends. Use this when you need more than basic scVelo:3132### Backend selection guide3334| Backend | Best for | GPU? | Prerequisites |35|---------|----------|------|---------------|36| **scvelo** | Standard velocity analysis | No | spliced/unspliced layers |37| **dynamo** | Kinetics modeling, vector fields | No | spliced/unspliced layers |38| **latentvelo** | VAE-based, batch correction, complex dynamics | Yes (torchdiffeq) | celltype_key, batch_key optional |39| **graphvelo** | Refinement layer on top of any backend | No | base velocity + connectivities |4041### Unified Velo pipeline4243```python44import omicverse as ov4546velo = ov.single.Velo(adata)4748# 1. Filter (scvelo backend) or preprocess (dynamo backend)49velo.filter_genes(min_shared_counts=20) # For scvelo50# velo.preprocess(recipe='monocle', n_neighbors=30, n_pcs=30) # For dynamo5152# 2. Compute moments53velo.moments(backend='scvelo', n_pcs=30, n_neighbors=30)54# backend: 'scvelo' or 'dynamo'5556# 3. Fit kinetic parameters57velo.dynamics(backend='scvelo')5859# 4. Calculate velocity60velo.cal_velocity(method='scvelo')61# method: 'scvelo', 'dynamo', 'latentvelo', 'graphvelo'6263# 5. Build velocity graph and project to embedding64velo.velocity_graph(basis='umap')65velo.velocity_embedding(basis='umap')66```6768### latentvelo specifics (deep learning velocity)6970latentvelo uses a VAE + neural ODE to learn latent dynamics. It handles batch effects and complex trajectories better than classical scVelo:7172```python73velo.cal_velocity(74 method='latentvelo',75 celltype_key='cell_type', # Optional: AnnotVAE uses cell type info76 batch_key='batch', # Optional: batch correction77 velocity_key='velocity_S',78 n_top_genes=2000,79 latentvelo_VAE_kwargs={}, # Pass custom VAE hyperparameters80)81# Requires: pip install torchdiffeq82# Uses GPU if available, falls back to CPU83```8485### graphvelo specifics (refinement layer)8687GraphVelo refines velocity estimates from any base method by leveraging the cell graph structure. Run it after scvelo or dynamo:8889```python90# First: compute base velocity with scvelo or dynamo91velo.cal_velocity(method='scvelo')9293# Then: refine with graphvelo94velo.graphvelo(95 xkey='Ms', # Spliced moments key96 vkey='velocity_S', # Base velocity key to refine97 basis_keys=['X_umap', 'X_pca'], # Project to multiple embeddings98 gene_subset=None, # Optional: restrict to gene subset99)100```101102## Downstream fate scoring notebooks103- **CellFateGenie**: For pseudotime-associated gene discovery, use `search_skills('CellFateGenie fate genes')` to load the dedicated CellFateGenie skill.104- **`t_metacells.ipynb`**: Aggregate metacell trajectories for robustness checks and meta-state differential expression.105- **`t_cytotrace.ipynb`**: Integrate CytoTRACE differentiation potential with velocity-informed lineages for maturation scoring.106107## Required preprocessing1081. Quality control: remove low-quality cells/genes, apply doublet filtering.1092. Normalization & log transformation (`sc.pp.normalize_total`, `sc.pp.log1p`).1103. Highly variable gene selection tailored to immune datasets (`sc.pp.highly_variable_genes`).1114. Batch correction if necessary (e.g., `scvi-tools`, `bbknn`).1125. Compute PCA, neighbor graph, and embedding (UMAP/FA) used by all trajectory methods.1136. For velocity: compute moments on the same neighbor graph before running VIA coupling.114115## Parameter tuning116- Neighbor graph `n_neighbors` and `n_pcs` should be harmonized across PAGA, VIA, and Palantir to maintain consistency.117- In VIA, adjust `knn`, `too_big_factor`, and `root_user` for datasets with uneven sampling.118- Palantir requires careful start cell selection; use marker genes and velocity arrows to confirm.119- For PAGA, tweak `threshold` to control edge sparsity; ensure connected components reflect biological branches.120- Velocity estimation: compare `mode='stochastic'` vs `mode='dynamical'` in scVelo; recalibrate if terminal states disagree with VIA.121122## Visualization and export1231. Overlay PAGA edges on UMAP (`scv.pl.paga`) and annotate branch labels.1242. Plot Palantir pseudotime and branch probabilities on embeddings.1253. Visualize VIA trajectories using `via.plot_fates` and `via.plot_scatter`.1264. Export pseudotime tables and fate probabilities to CSV for downstream notebooks.1275. Save high-resolution figures (PNG/SVG) and notebook artifacts for reproducibility.1286. Update notebooks with consistent color schemes and metadata columns before sharing.129130## Defensive Validation Patterns131132```python133# Before PAGA: verify neighbor graph exists134assert 'neighbors' in adata.uns, "Neighbor graph required. Run sc.pp.neighbors(adata) first."135136# Before VIA velocity coupling: verify velocity layers exist137if 'velocity' not in adata.layers:138 print("WARNING: velocity layer missing. Run scv.tl.velocity(adata) first for VIA coupling.")139assert 'spliced' in adata.layers and 'unspliced' in adata.layers, \140 "Missing spliced/unspliced layers. Check loom/H5AD import preserved velocity layers."141142# Before Palantir: verify PCA/diffusion components143assert 'X_pca' in adata.obsm, "PCA required. Run ov.pp.pca(adata) first."144```145146## Troubleshooting tips147- **Missing velocity layers**: re-run `scv.pp.moments` and `scv.tl.velocity` ensuring `adata.layers['spliced']`/`['unspliced']` exist; verify loom/H5AD import preserved layers.148- **Disconnected PAGA graph**: inspect neighbor graph or adjust `n_neighbors`; confirm batch correction didn’t fragment the manifold.149- **Palantir convergence issues**: reduce diffusion components or reinitialize start cells; ensure no NaN values in data matrix.150- **VIA terminal states unstable**: increase iterations (`cluster_graph_pruning_iter`), or provide manual terminal state hints based on marker expression.151- **Notebook kernel memory errors**: downsample cells or precompute summaries (metacells) before rerunning.152- **latentvelo `ImportError: torchdiffeq`**: Install with `pip install torchdiffeq`. Required for neural ODE backend.153- **graphvelo returns NaN velocities**: Ensure base velocity (scvelo/dynamo) was computed first. graphvelo refines — it doesn't compute from scratch.154- **dynamo `preprocess` fails**: dynamo expects spliced/unspliced layers. Verify with `'spliced' in adata.layers`.