TXPipe — DESC 3×2pt weak-lensing pipeline
You're helping a user work with TXPipe, the main DESC analysis workhorse.
TXPipe processes shear and photometric catalogs through sample selection, map generation, two-point measurements (real and Fourier space), covariance estimation, theory comparison, and diagnostics.
All stages are ceci PipelineStage subclasses; for ceci conventions see the ceci skill.
For NERSC job submission, see the nersc skill.
Key library dependencies: NaMaster (namaster skill) for Fourier C_ℓ measurements and covariance; CCL (ccl skill) for theory predictions; Firecrown (firecrown skill) is used internally by theory/blinding stages and consumes TXPipe's sacc output for parameter inference.
Pipeline phases (in order)
- Ingestion —
TXIngestDataPreview02,TXCosmoDC2Mock, etc. — source-specific; using the wrong ingester silently reads wrong columns - Photo-z — RAIL stages (
PZEstimatorLens/Source,PZRailSummarizeLens/Source); must produceQPNOfZFilebefore 2pt - Selection —
TXSourceSelectorMetadetect/Metacal/Lensfit/HSC+TXSourceTomography;TXMeanLensSelectorfor lenses - Calibration —
TXShearCalibrationthenTXTracerMetadata(both required; calibration must precede tomography) - Masks —
TXSimpleMaskorTXCustomMask; nside must match map nside everywhere - Maps —
TXSourceMaps,TXLensMaps,TXAuxiliarySourceMaps/LensMaps,TXLSSWeights - Noise maps —
TXSourceNoiseMaps(30 realisations),5); required for covarianceTXLensNoiseMaps( - Two-point real —
TXTwoPoint(TreeCorr; ξ±, γ_t, w(θ)); usesTXJackknifeCentersfor jackknife cov - Two-point Fourier —
TXTwoPointFourier(NaMaster; C_ℓ for shear-shear, shear-pos, pos-pos; seenamasterskill) - Covariance —
TXFourierNamasterCovariance/TXRealNamasterCovariance(expensive; useTXFourierGaussianCovariancefor quick tests; seenamasterskill) - Theory & blinding —
TXTwoPointTheoryReal/Fourier(CCL; seecclskill);TXBlinding(Firecrown internally; seefirecrownskill) - Diagnostics —
TXPSFDiagnostics,TXRoweStatistics,TXTauStatistics,TXSourceDiagnosticPlots,TXTwoPointPlots
The examples/metadetect/ pipeline is the canonical full-pipeline reference.
Reference
| Topic | Reference |
|---|---|
| Pipeline phases and stage names | references/txpipe-stages.md |
| Key file types, pipeline YAML structure, example pipelines, gotchas | references/txpipe-pipeline.md |