hrms-data-format-parsing
Summary
Parse and load experimental high-resolution tandem mass spectrometry (HRMS/MS) data from instrument-specific file formats (mzML, CSV peaklists, vendor formats) into a standardized in-memory representation suitable for fragment m/z matching and lipid identification workflows. This skill bridges raw instrument output to downstream lipidomics analysis.
When to use
You have raw or processed HRMS/MS data from Q-Exactive, Agilent Q-TOF, Bruker Q-TOF, or SCIEX Q-TOF instruments in formats such as mzML, CSV peaklists, or vendor-specific formats, and you need to extract experimental fragment m/z values and their intensities for comparison against in-silico lipid fragmentation libraries.
When NOT to use
- Input is already a vendor-independent, harmonized peaklist or feature table from peak-picking software (MZmine, XCMS, MS-DIAL, or Compound Discoverer); use that output directly.
- Data is from Waters UHPLC-HRMS/MS instruments; LipidMatch does not currently support Waters files.
- Raw m/z values have already been matched to library fragments; this skill applies only to raw or minimally processed experimental data.
Inputs
- mzML files from Q-Exactive or Q-TOF UHPLC-HRMS/MS
- CSV peaklist files (Q-Exactive or Q-TOF format) with m/z and intensity columns
- Vendor-specific raw files or vendor-converted CSV exports
Outputs
- Structured peaklist table (m/z, intensity, optional: retention time, charge state)
- In-memory array of experimental fragment m/z values
- Validated peaklist ready for downstream m/z matching and lipid identification
How to apply
Load experimental peaklist files in CSV or mzML-derived table format containing m/z and intensity pairs from your HRMS/MS instrument (Q-Exactive orbitrap or Q-TOF platforms). Parse the file headers and data columns to extract fragment m/z values and associated metadata. Ensure mass values are in the same mass tolerance units (typically ppm or Da) that will be used in the downstream m/z matching step. Validate that the parsed m/z range and intensity distribution are consistent with the acquisition method (targeted, data-dependent MS/MS top-N, or all-ion fragmentation). Output a structured table or in-memory array of m/z–intensity pairs ready for matching against the LipidMatch in-silico library.
Related tools
- MZmine (Peak picking and peaklist generation from raw HRMS/MS data; produces CSV or other formats compatible with LipidMatch input)
- XCMS (Centroiding and peak detection from mzML or netCDF; exports peaklist for m/z matching workflows)
- MS-DIAL (Peak picking and spectral deconvolution for HRMS/MS data; generates peaklists for downstream matching)
- Compound Discoverer (Commercial peak picking and annotation software compatible with LipidMatch input format)
- Q-Exactive orbitrap (Thermo HRMS/MS instrument producing mzML and vendor-format files containing experimental fragment m/z data)
- Agilent Q-TOF UHPLC-HRMS/MS (Agilent TOF instrument generating peaklists and raw files with fragment m/z values)
- Bruker Q-TOF UHPLC-HRMS/MS (Bruker TOF instrument producing raw and converted peaklist formats for fragment matching)
- SCIEX Q-TOF UHPLC-HRMS/MS (SCIEX TOF instrument generating peaklists compatible with LipidMatch input specifications)
Evaluation signals
- Parsed peaklist contains m/z values in expected range (typically 100–1200 m/z for lipidomics), with no missing or corrupted entries.
- Intensity values are positive and span a reasonable dynamic range (e.g., 1e4 to 1e8 for orbitrap data); no negative or zero intensities in valid peaks.
- Header row and column mapping are correctly identified; optional metadata (retention time, charge state) are present and non-null where expected.
- Parsed data structure matches the input format specification (e.g., CSV with columns [m/z, intensity, ...] or mzML scan-level m/z–intensity arrays).
- Data integrity check: file size, row count, and column count are consistent; no truncated or corrupted records detected.
Limitations
- Waters UHPLC-HRMS/MS files are not currently supported by downstream LipidMatch matching; data from Waters instruments cannot proceed in this workflow.
- mzML parsing requires correct mzML format compliance; malformed or non-standard mzML variants may fail to parse correctly.
- CSV peaklist parsing is format-dependent; inconsistent column headers, delimiters, or decimal formats across vendor implementations may cause parsing errors.
- Mass calibration errors in raw data are not corrected during parsing; ensure instrument mass calibration is adequate before file acquisition.
Evidence
- [other] Load experimental fragment m/z values from a peaklist file (Q-Exactive or Q-TOF format, e.g., CSV or mzML-derived table): "Load experimental fragment m/z values from a peaklist file (Q-Exactive or Q-TOF format, e.g., CSV or mzML-derived table)"
- [readme] LipidMatch identifications are obtained by matching experimental fragment m/z values with simulated library m/z values using in-silico fragmentation libraries: "LipidMatch identifications are obtained by matching experimental fragment m/z values with simulated library m/z values using in-silico fragmentation libraries"
- [readme] LipidMatch has been tested and validated using Q-Exactive orbitrap UHPLC-HRMS/MS data obtained from multiple sample types using targeted, data-dependent top-N (ddMS2-topN), and all ion fragmentation (AIF) approaches, as well as Agilent, Bruker and SCIEX Q-TOF UHPLC-HRMS/MS experiments: "LipidMatch has been tested and validated using Q-Exactive orbitrap UHPLC-HRMS/MS data obtained from multiple sample types using targeted, data-dependent top-N (ddMS2-topN), and all ion fragmentation"
- [readme] The software does not currently support Waters files: "The software does not currently support Waters files"
- [readme] LipidMatch can be used with various peak picking software (for example MZmine, XCMS, MS-DIAL, and Compound Discoverer): "LipidMatch can be used with various peak picking software (for example MZmine, XCMS, MS-DIAL, and Compound Discoverer)"
1---2name: hrms-data-format-parsing-33description: Use when you have raw or processed HRMS/MS data from Q-Exactive, Agilent4 Q-TOF, Bruker Q-TOF, or SCIEX Q-TOF instruments in formats such as mzML, CSV peaklists,5 or vendor-specific formats, and you need to extract experimental fragment m/z values6 and their intensities for comparison against.7license: CC-BY-4.08metadata:9 source: https://skillmd.com/skills/holobiomicslab/hrms-data-format-parsing-310 edam_operation: http://edamontology.org/operation_335711 edam_topics:12 - http://edamontology.org/topic_012113 - http://edamontology.org/topic_317214 tools:15 - Q-Exactive orbitrap16 - Agilent Q-TOF UHPLC-HRMS/MS17 - Bruker Q-TOF UHPLC-HRMS/MS18 - SCIEX Q-TOF UHPLC-HRMS/MS19 - MZmine20 - XCMS21 - MS-DIAL22 - Compound Discoverer23 techniques:24 - LC-MS25 license_tier: open26 provenance_tier: literature27derived_from:28- doi: 10.1186/s12859-017-1744-329 title: lipidmatch30evidence_spans:31- tested and validated using Q-Exactive orbitrap UHPLC-HRMS/MS data32- Agilent, Bruker and SCIEX Q-TOF UHPLC-HRMS/MS experiments33claims: []34provenance:35 collection: https://w3id.org/holobiomicslab/asb-skill/collection/metabolomics/v236 assembled_by: scripts/collect_metabolomics_collection.py37 sources:38 - build: coll_lipidmatch39 doi: 10.1186/s12859-017-1744-340 title: lipidmatch41 dedup_kept_from: coll_lipidmatch42schema_version: 0.2.043attribution:44 generator: AgenticScienceBuilder45 original_doi: 10.1186/s12859-017-1744-346 all_source_dois:47 - 10.1186/s12859-017-1744-348 zenodo_doi: 10.5281/zenodo.2079402749 curators: []50 promoter: Louis-Félix Nothias51 sponsor: CNRS & Université Côte d'Azur52---5354# hrms-data-format-parsing5556## Summary5758Parse and load experimental high-resolution tandem mass spectrometry (HRMS/MS) data from instrument-specific file formats (mzML, CSV peaklists, vendor formats) into a standardized in-memory representation suitable for fragment m/z matching and lipid identification workflows. This skill bridges raw instrument output to downstream lipidomics analysis.5960## When to use6162You have raw or processed HRMS/MS data from Q-Exactive, Agilent Q-TOF, Bruker Q-TOF, or SCIEX Q-TOF instruments in formats such as mzML, CSV peaklists, or vendor-specific formats, and you need to extract experimental fragment m/z values and their intensities for comparison against in-silico lipid fragmentation libraries.6364## When NOT to use6566- Input is already a vendor-independent, harmonized peaklist or feature table from peak-picking software (MZmine, XCMS, MS-DIAL, or Compound Discoverer); use that output directly.67- Data is from Waters UHPLC-HRMS/MS instruments; LipidMatch does not currently support Waters files.68- Raw m/z values have already been matched to library fragments; this skill applies only to raw or minimally processed experimental data.6970## Inputs7172- mzML files from Q-Exactive or Q-TOF UHPLC-HRMS/MS73- CSV peaklist files (Q-Exactive or Q-TOF format) with m/z and intensity columns74- Vendor-specific raw files or vendor-converted CSV exports7576## Outputs7778- Structured peaklist table (m/z, intensity, optional: retention time, charge state)79- In-memory array of experimental fragment m/z values80- Validated peaklist ready for downstream m/z matching and lipid identification8182## How to apply8384Load experimental peaklist files in CSV or mzML-derived table format containing m/z and intensity pairs from your HRMS/MS instrument (Q-Exactive orbitrap or Q-TOF platforms). Parse the file headers and data columns to extract fragment m/z values and associated metadata. Ensure mass values are in the same mass tolerance units (typically ppm or Da) that will be used in the downstream m/z matching step. Validate that the parsed m/z range and intensity distribution are consistent with the acquisition method (targeted, data-dependent MS/MS top-N, or all-ion fragmentation). Output a structured table or in-memory array of m/z–intensity pairs ready for matching against the LipidMatch in-silico library.8586## Related tools8788- **MZmine** (Peak picking and peaklist generation from raw HRMS/MS data; produces CSV or other formats compatible with LipidMatch input)89- **XCMS** (Centroiding and peak detection from mzML or netCDF; exports peaklist for m/z matching workflows)90- **MS-DIAL** (Peak picking and spectral deconvolution for HRMS/MS data; generates peaklists for downstream matching)91- **Compound Discoverer** (Commercial peak picking and annotation software compatible with LipidMatch input format)92- **Q-Exactive orbitrap** (Thermo HRMS/MS instrument producing mzML and vendor-format files containing experimental fragment m/z data)93- **Agilent Q-TOF UHPLC-HRMS/MS** (Agilent TOF instrument generating peaklists and raw files with fragment m/z values)94- **Bruker Q-TOF UHPLC-HRMS/MS** (Bruker TOF instrument producing raw and converted peaklist formats for fragment matching)95- **SCIEX Q-TOF UHPLC-HRMS/MS** (SCIEX TOF instrument generating peaklists compatible with LipidMatch input specifications)9697## Evaluation signals9899- Parsed peaklist contains m/z values in expected range (typically 100–1200 m/z for lipidomics), with no missing or corrupted entries.100- Intensity values are positive and span a reasonable dynamic range (e.g., 1e4 to 1e8 for orbitrap data); no negative or zero intensities in valid peaks.101- Header row and column mapping are correctly identified; optional metadata (retention time, charge state) are present and non-null where expected.102- Parsed data structure matches the input format specification (e.g., CSV with columns [m/z, intensity, ...] or mzML scan-level m/z–intensity arrays).103- Data integrity check: file size, row count, and column count are consistent; no truncated or corrupted records detected.104105## Limitations106107- Waters UHPLC-HRMS/MS files are not currently supported by downstream LipidMatch matching; data from Waters instruments cannot proceed in this workflow.108- mzML parsing requires correct mzML format compliance; malformed or non-standard mzML variants may fail to parse correctly.109- CSV peaklist parsing is format-dependent; inconsistent column headers, delimiters, or decimal formats across vendor implementations may cause parsing errors.110- Mass calibration errors in raw data are not corrected during parsing; ensure instrument mass calibration is adequate before file acquisition.111112## Evidence113114- [other] Load experimental fragment m/z values from a peaklist file (Q-Exactive or Q-TOF format, e.g., CSV or mzML-derived table): "Load experimental fragment m/z values from a peaklist file (Q-Exactive or Q-TOF format, e.g., CSV or mzML-derived table)"115- [readme] LipidMatch identifications are obtained by matching experimental fragment m/z values with simulated library m/z values using in-silico fragmentation libraries: "LipidMatch identifications are obtained by matching experimental fragment m/z values with simulated library m/z values using in-silico fragmentation libraries"116- [readme] LipidMatch has been tested and validated using Q-Exactive orbitrap UHPLC-HRMS/MS data obtained from multiple sample types using targeted, data-dependent top-N (ddMS2-topN), and all ion fragmentation (AIF) approaches, as well as Agilent, Bruker and SCIEX Q-TOF UHPLC-HRMS/MS experiments: "LipidMatch has been tested and validated using Q-Exactive orbitrap UHPLC-HRMS/MS data obtained from multiple sample types using targeted, data-dependent top-N (ddMS2-topN), and all ion fragmentation"117- [readme] The software does not currently support Waters files: "The software does not currently support Waters files"118- [readme] LipidMatch can be used with various peak picking software (for example MZmine, XCMS, MS-DIAL, and Compound Discoverer): "LipidMatch can be used with various peak picking software (for example MZmine, XCMS, MS-DIAL, and Compound Discoverer)"