Cellpose — Deep Learning Cell Segmentation
Overview
Cellpose uses flow-based neural networks to segment individual cells or nuclei in fluorescence microscopy images without manual parameter tuning. Cellpose 4.2 includes Cellpose-SAM and CellposeDINO models (cpsam_v2, cpdino, cpdino-vitb, and cpsam) trained across varied cell types, magnifications, and staining conditions. It outputs integer label masks (each cell = unique integer) compatible with scikit-image regionprops for morphology measurement and TrackPy for tracking. Supplying an approximate diameter is optional and rescales unusually large objects relative to the models' 30-pixel training diameter.
[!NOTE] Cellpose 4.x API change: The
cellpose.models.Cellposeconvenience class was removed. Usecellpose.models.CellposeModel;model.eval()returns(masks, flows, styles). The oldmodel_type=andchannels=arguments are ignored in 4.2.1. Choose a built-in model withpretrained_model=, and slice or stack the desired image channels before callingeval().
When to Use
- Segmenting cells or nuclei in fluorescence microscopy images where rule-based thresholding fails due to varying intensity or cell touching
- Processing large microscopy datasets in batch without per-image parameter tuning
- Segmenting diverse cell types (adherent cells, blood cells, bacteria, organoids) with a single model
- Producing label masks for downstream region property measurement (area, intensity, shape) with scikit-image
- 3D volumetric segmentation of z-stack microscopy data with
do_3D=True - Use scikit-image watershed when cells are well-separated and rule-based thresholding is sufficient
- Use StarDist as an alternative deep learning segmenter optimized for star-convex cells (neurons, nuclei)
Prerequisites
- Python packages:
cellpose,numpy,matplotlib - Optional: GPU with CUDA for 10-50× speedup (
uv pip install "cellpose[gui]"for GUI) - Input: grayscale or multichannel TIFF/PNG images (2D or 3D arrays)
# Create and activate an isolated environment
uv venv
source .venv/bin/activate
# Standard install (choose this or the GUI install)
uv pip install "cellpose==4.2.1"
uv pip install "cellpose[gui]==4.2.1"
# Reproducible NVIDIA GPU install for CUDA 12.4
uv pip install "torch==2.6.0" "torchvision==0.21.0" \
--index-url https://download.pytorch.org/whl/cu124
uv pip install "cellpose==4.2.1"
# Verify
python -c "from cellpose import models; print('Cellpose ready')"
Quick Start
from cellpose import models
import numpy as np
from skimage import io
# Load image (grayscale or 2D array)
img = io.imread("cells.tif") # shape: (H, W) or (H, W, C)
channel_axis = -1 if img.ndim == 3 else None
# Initialize model and segment
model = models.CellposeModel(pretrained_model="cpsam_v2", gpu=False)
masks, flows, styles = model.eval(img, channel_axis=channel_axis)
print(f"Cells segmented: {masks.max()}") # number of cells
print(f"Mask shape: {masks.shape}")
Workflow
Step 1: Load and Inspect Images
Load microscopy images and inspect channel layout before segmentation.
import numpy as np
from skimage import io
import matplotlib.pyplot as plt
# Load single-channel fluorescence image
img_gray = io.imread("nucleus_dapi.tif") # shape: (H, W)
img_rgb = io.imread("cells_multichannel.tif") # shape: (H, W, C)
print(f"Grayscale shape: {img_gray.shape}, dtype: {img_gray.dtype}")
print(f"Multichannel shape: {img_rgb.shape}")
# Preview
fig, axes = plt.subplots(1, 2, figsize=(12, 5))
axes[0].imshow(img_gray, cmap="gray")
axes[0].set_title("DAPI (nuclei)")
axes[1].imshow(img_rgb[..., 0], cmap="green")
axes[1].set_title("GFP channel")
plt.tight_layout()
plt.savefig("image_preview.png", dpi=100)
print("Saved: image_preview.png")
Step 2: Segment Cells with a Pre-trained Model
Run Cellpose with the appropriate pre-trained model.
from cellpose import models
import numpy as np
from skimage import io
# Built-in 4.2 models: "cpsam_v2", "cpdino", "cpdino-vitb", and "cpsam"
model = models.CellposeModel(pretrained_model="cpsam_v2", gpu=False)
img = io.imread("cells.tif")
# Cellpose 4 uses the first three channels and is invariant to their order.
# For HWC images, identify the channel axis explicitly.
masks, flows, styles = model.eval(
img,
channel_axis=-1 if img.ndim == 3 else None,
flow_threshold=0.4, # lower = fewer false positives; range 0.1-1.0
cellprob_threshold=0.0, # lower = more cells detected; range -6 to 6
)
print(f"Cells found: {masks.max()}")
np.save("masks.npy", masks)
Step 3: Segment Nuclei from DAPI Channel
The generalist Cellpose-SAM model also handles single-channel DAPI images.
from cellpose import models
from skimage import io
import numpy as np
model = models.CellposeModel(pretrained_model="cpsam_v2", gpu=False)
dapi = io.imread("dapi.tif")
# A 2D DAPI image needs no channel selection.
masks, flows, styles = model.eval(
dapi,
diameter=30, # approximate nucleus diameter in pixels
flow_threshold=0.4,
cellprob_threshold=0.0,
)
print(f"Nuclei segmented: {masks.max()}")
# Save label mask as TIFF for ImageJ/FIJI compatibility
from skimage import io as skio
skio.imsave("nuclei_masks.tif", masks.astype(np.uint16))
print("Saved: nuclei_masks.tif")
Step 4: Visualize Segmentation Results
Overlay masks on original images for quality control.
from cellpose import plot as cpplot
import matplotlib.pyplot as plt
import numpy as np
from skimage import io
img = io.imread("cells.tif")
masks = np.load("masks.npy")
flows_data = None # load if you saved them: flows = np.load("flows.npy", allow_pickle=True)
# Cellpose built-in visualization
fig, axes = plt.subplots(1, 3, figsize=(15, 5))
# Original image
axes[0].imshow(img, cmap="gray")
axes[0].set_title(f"Original image")
# Label mask (each cell = unique color)
axes[1].imshow(masks, cmap="tab20")
axes[1].set_title(f"Segmentation masks ({masks.max()} cells)")
# Overlay: outline on original
from skimage.segmentation import find_boundaries
boundaries = find_boundaries(masks, mode="inner")
overlay = np.stack([img / img.max()] * 3, axis=-1)
overlay[boundaries] = [1, 0, 0] # red outlines
axes[2].imshow(overlay)
axes[2].set_title("Outlines overlay")
plt.tight_layout()
plt.savefig("segmentation_result.png", dpi=150)
print("Saved: segmentation_result.png")
Step 5: Measure Cell Properties from Masks
Extract morphology and intensity measurements using scikit-image regionprops.
import numpy as np
import pandas as pd
from skimage.measure import regionprops_table
from skimage import io
masks = np.load("masks.npy")
img = io.imread("cells.tif")
# Measure morphology and intensity per cell
props = regionprops_table(
masks, intensity_image=img,
properties=["label", "area", "centroid", "eccentricity",
"mean_intensity", "max_intensity", "perimeter",
"equivalent_diameter_area"]
)
df = pd.DataFrame(props)
df.columns = ["cell_id", "area_px", "centroid_y", "centroid_x",
"eccentricity", "mean_intensity", "max_intensity",
"perimeter", "diameter_px"]
print(f"Cells measured: {len(df)}")
print(f"Median area: {df['area_px'].median():.0f} px²")
print(f"Median diameter: {df['diameter_px'].median():.1f} px")
print(df.head())
df.to_csv("cell_measurements.csv", index=False)
Step 6: Batch Segment Multiple Images
Process a directory of images and aggregate results.
from cellpose import models
from skimage import io
from skimage.measure import regionprops_table
import pandas as pd
import numpy as np
from pathlib import Path
model = models.CellposeModel(pretrained_model="cpsam_v2", gpu=False)
image_dir = Path("images/")
output_dir = Path("results/")
output_dir.mkdir(exist_ok=True)
all_stats = []
for img_path in sorted(image_dir.glob("*.tif")):
img = io.imread(img_path)
masks, _, _ = model.eval(
img,
channel_axis=-1 if img.ndim == 3 else None,
)
# Save mask
np.save(output_dir / f"{img_path.stem}_masks.npy", masks)
# Measure
if masks.max() > 0:
props = regionprops_table(masks, intensity_image=img,
properties=["label", "area", "mean_intensity"])
df = pd.DataFrame(props)
df["image"] = img_path.name
all_stats.append(df)
print(f"{img_path.name}: {masks.max()} cells")
summary = pd.concat(all_stats, ignore_index=True)
summary.to_csv(output_dir / "all_cells.csv", index=False)
print(f"\nTotal cells: {len(summary)} across {summary['image'].nunique()} images")
Key Parameters
| Parameter | Default | Range/Options | Effect |
|---|---|---|---|
pretrained_model |
"cpsam_v2" |
"cpsam_v2", "cpdino", "cpdino-vitb", "cpsam", custom path |
Built-in or user-trained model weights |
diameter |
None |
positive pixel value | Optional rescaling relative to the 30-pixel training diameter; omitted means no rescaling |
channel_axis |
None |
integer axis or None |
Identifies the channel dimension; preselect relevant channels before inference |
flow_threshold |
0.4 |
0.1–1.0 | Maximum allowed flow error; higher values accept more masks |
cellprob_threshold |
0.0 |
−6 to 6 | Cell probability cutoff; lower values detect more cells |
gpu |
False |
True, False |
Enable GPU inference (requires CUDA PyTorch) |
do_3D |
False |
True, False |
Enable 3D volumetric segmentation of z-stacks |
min_size |
15 |
integer px² | Minimum object size in pixels²; smaller objects discarded |
batch_size |
8 |
integer | Number of image tiles processed per GPU batch |
normalize |
True |
True, False |
Normalize image intensity before segmentation |
Common Recipes
Recipe 1: Segment Multichannel Image (GFP + DAPI)
from cellpose import models
from skimage import io
import numpy as np
model = models.CellposeModel(pretrained_model="cpsam_v2", gpu=False)
# Multichannel image: channel 2 = GFP, channel 3 = DAPI (1-indexed labels)
img_multi = io.imread("cells_gfp_dapi.tif") # shape: (H, W, 3)
# Cellpose 4 ignores channels=[...]; slice the HWC array explicitly.
img_gfp_dapi = img_multi[..., [1, 2]]
masks, flows, styles = model.eval(
img_gfp_dapi,
channel_axis=-1,
flow_threshold=0.4,
)
print(f"Cells segmented: {masks.max()}")
np.save("masks_multichannel.npy", masks)
Recipe 2: Use Cellpose CLI for Directory Batch Processing
# CLI batch segmentation of all TIFFs in a directory
cellpose \
--dir images/ \
--pretrained_model cpsam_v2 \
--save_tif \
--no_npy
# With GPU
cellpose \
--dir images/ \
--pretrained_model cpsam_v2 \
--diameter 30 \
--use_gpu \
--save_tif
# Results saved as: images/*_cp_masks.tif
echo "Done. Masks saved in images/ directory."
Recipe 3: Fine-tune Cellpose on Custom Cell Type
from cellpose import models, train
import numpy as np
from skimage import io
# Prepare training data: list of images and corresponding masks
train_images = [io.imread(f"train/img_{i}.tif") for i in range(10)]
train_masks = [np.load(f"train/mask_{i}.npy") for i in range(10)]
# Fine-tune starting from the current Cellpose-SAM model
model = models.CellposeModel(pretrained_model="cpsam_v2")
channel_axis = -1 if train_images[0].ndim == 3 else None
# Train: saves model to models/ directory
model_path, train_losses, test_losses = train.train_seg(
model.net,
train_data=train_images,
train_labels=train_masks,
channel_axis=channel_axis,
save_path="models/",
n_epochs=100,
learning_rate=1e-5,
weight_decay=0.1,
)
print(f"Fine-tuned model saved: {model_path}")
Expected Outputs
| Output | Format | Description |
|---|---|---|
masks array |
numpy int32 | Label mask: 0=background, 1..N=unique cell IDs |
flows list |
numpy arrays | Flow field components: [XY flows, cell prob, gradient] |
styles array |
numpy float | Style vector embedding (zeros in Cellpose-SAM models) |
*_masks.npy |
NumPy | Saved mask array (from np.save) |
*_cp_masks.tif |
TIFF uint16 | Mask TIFF (from CLI --save_tif); compatible with FIJI/ImageJ |
Troubleshooting
| Problem | Cause | Solution |
|---|---|---|
AttributeError: module 'cellpose.models' has no attribute 'Cellpose' |
cellpose 4.x removed Cellpose class |
Use models.CellposeModel(...) instead |
ValueError: not enough values to unpack from eval() |
Cellpose 4 returns three values, not four | Unpack masks, flows, styles |
| Very few cells detected | flow_threshold too low or cellprob_threshold too high |
Increase flow_threshold or lower cellprob_threshold |
| Many false positives (background labeled) | flow_threshold too high or cellprob_threshold too low |
Lower flow_threshold, raise cellprob_threshold, or increase min_size |
| GPU out of memory | Image too large for GPU batch | Process in tiles; reduce batch_size; crop image |
| Poor generalization on new cell type | Model not trained on similar cells | Try cpsam_v2 and cpdino; fine-tune with 10-20 annotated images |
| 3D segmentation very slow | Large z-stack on CPU | Enable GPU; reduce z-stack depth; use anisotropy parameter |
| Mask values overflow uint8 | More than 255 cells in image | Save with dtype=np.uint16 or np.int32 |
Import error: No module named 'cellpose' |
Package not installed | uv pip install cellpose |
References
- Cellpose GitHub: MouseLand/cellpose — source code, documentation, and model zoo
- Stringer C et al. (2021) "Cellpose: a generalist algorithm for cellular segmentation" — Nature Methods 18:100-106. DOI:10.1038/s41592-020-01018-x
- Pachitariu M & Stringer C (2022) "Cellpose 2.0: how to train your own model" — Nature Methods 19:1500-1508. DOI:10.1038/s41592-022-01663-4
- Cellpose documentation — official API reference and training guide