metabolomics-data-matrix-handling
Summary
Structuring and preparing metabolomics feature data, sample metadata, and metabolite annotations into the standardized three-part input format required by the NormalizeMets package. This skill ensures data are correctly formatted before normalization, quality-control assessment, and biomarker analysis workflows.
When to use
When you have raw metabolomics peak intensities or concentrations and accompanying sample metadata (batch, run order, sample type, factors of interest) and need to organize them into the featuredata, sampledata, and metabolitedata dataframes that NormalizeMets functions expect. Specifically when preparing data for RLSC normalization, QC-based batch correction, or relative log abundance diagnostic visualization.
When NOT to use
- Input data are already correctly formatted in featuredata/sampledata/metabolitedata structure with validated row/column names and no missing cross-references.
- You are working with pre-processed, already-normalized feature tables from external sources that do not require reproducible batch correction or QC assessment.
- Your analysis only requires visualization or univariate statistical tests and does not depend on consistent data structures for downstream NormalizeMets functions.
Inputs
- Raw peak intensity matrix (samples × metabolites)
- Sample metadata table (sample identifiers, batch/run order, sample type, factors)
- Metabolite annotation table (metabolite identifiers, standard/control designations)
Outputs
- featuredata dataframe (samples × metabolites matrix with named rows and columns)
- sampledata dataframe (sample-level metadata with named rows)
- metabolitedata dataframe (metabolite-level annotations with named rows)
How to apply
Organize your metabolomics data into three linked dataframes: (1) featuredata: a matrix with unique sample names as row names and unique metabolite names as column names, containing peak intensities or concentrations; (2) sampledata: a dataframe with unique sample names as row names and columns for sample type, run order, batch assignment, and factors of interest; (3) metabolitedata: a dataframe with unique metabolite names as row names and columns for metabolite-specific annotations (e.g., internal/external standard designation, positive/negative control flags). Ensure row/column names are unique and consistent across dataframes. When using QC-based normalization (e.g., NormQcsamples), sort featuredata and sampledata by the run order column before function calls. Verify that all samples in featuredata have corresponding rows in sampledata and all metabolites have corresponding rows in metabolitedata.
Related tools
- NormalizeMets (R package that consumes the three-part featuredata/sampledata/metabolitedata structure for normalization, QC assessment, and biomarker identification workflows) — https://github.com/metabolomicstats/NormalizeMets
- R (Programming environment for constructing and manipulating the dataframes; functions like data.frame(), row.names(), and merge() are used to organize and validate the structure)
- RStudio (IDE for interactive data inspection, validation, and debugging of the dataframe structure before passing to NormalizeMets functions)
- Microsoft Excel (Alternative interface (via ExNormalizeMets) for preparing and entering featuredata, sampledata, and metabolitedata prior to analysis in the NormalizeMets package)
Examples
featuredata <- read.csv('peaks.csv', row.names=1); sampledata <- read.csv('samples.csv', row.names=1); metabolitedata <- read.csv('metabolites.csv', row.names=1); sampledata <- sampledata[order(sampledata$order), ]; featuredata <- featuredata[rownames(sampledata), ]
Evaluation signals
- featuredata has unique, non-empty row names (sample identifiers) and column names (metabolite identifiers); no duplicate or missing names.
- sampledata has unique row names matching all samples in featuredata; contains 'order' column (run sequence) for QC-based normalization; all required grouping columns (batch, sample type) are present and non-empty.
- metabolitedata has unique row names matching all metabolites in featuredata; standard/control designations are explicitly recorded where applicable.
- Cross-reference validation: nrow(featuredata) == nrow(sampledata) and ncol(featuredata) == nrow(metabolitedata); rownames(featuredata) == rownames(sampledata) and colnames(featuredata) == rownames(metabolitedata).
- NormQcsamples or RlaPlots functions execute without errors related to missing or mismatched data; output plots and normalized matrices are produced with expected dimensions and metadata associations.
Limitations
- The package requires R version 3.4.3 or higher; older R installations will not support NormalizeMets or its dataframe operations.
- Missing values (NA, NaN) in featuredata require explicit handling via the MissingValues() function before normalization; the structure itself does not automatically impute or handle gaps.
- The sampledata 'order' column must reflect the actual run sequence and be numeric and sorted before calling QC-based normalization functions; inconsistent ordering will produce incorrect batch corrections.
- Metabolite names and sample names must be unique within their respective dataframes; duplicate identifiers will cause indexing failures and incorrect cross-referencing across featuredata, sampledata, and metabolitedata.
Evidence
- [readme] Input data format requirement: "The input data format consists of three parts: (i) "featuredata" which is the metabolomics data matrix containing all metabolite peak intensities (or concentrations). Unique sample names must be"
- [other] Sorting by run order for QC normalization: "Sort featuredata and sampledata by run order (sampledata$order column)."
- [readme] Sample metadata content specification: ""sampledata" is a dataframe that contains sample-specific information. These information can include sample type, order of analysis, factors of interest and other sample-specific data relevant to the"
- [readme] Metabolite annotation content specification: ""metabolitedata" contains metabolite-specific information in a separate dataframe. These information can include, but is not limited to, designation of metabolites as internal/external standards, or"
- [readme] Name consistency across dataframes: "Unique sample names must be provided as row names and unique metabolite names as column names"
1---2name: metabolomics-data-matrix-handling3description: Use when when you have raw metabolomics peak intensities or concentrations and accompanying sample metadata (batch, run order, sample type, factors of interest) and need to organize them into the featuredata, sampledata, and metabolitedata dataframes that NormalizeMets functions expect.4license: CC-BY-4.05---67# metabolomics-data-matrix-handling89## Summary1011Structuring and preparing metabolomics feature data, sample metadata, and metabolite annotations into the standardized three-part input format required by the NormalizeMets package. This skill ensures data are correctly formatted before normalization, quality-control assessment, and biomarker analysis workflows.1213## When to use1415When you have raw metabolomics peak intensities or concentrations and accompanying sample metadata (batch, run order, sample type, factors of interest) and need to organize them into the featuredata, sampledata, and metabolitedata dataframes that NormalizeMets functions expect. Specifically when preparing data for RLSC normalization, QC-based batch correction, or relative log abundance diagnostic visualization.1617## When NOT to use1819- Input data are already correctly formatted in featuredata/sampledata/metabolitedata structure with validated row/column names and no missing cross-references.20- You are working with pre-processed, already-normalized feature tables from external sources that do not require reproducible batch correction or QC assessment.21- Your analysis only requires visualization or univariate statistical tests and does not depend on consistent data structures for downstream NormalizeMets functions.2223## Inputs2425- Raw peak intensity matrix (samples × metabolites)26- Sample metadata table (sample identifiers, batch/run order, sample type, factors)27- Metabolite annotation table (metabolite identifiers, standard/control designations)2829## Outputs3031- featuredata dataframe (samples × metabolites matrix with named rows and columns)32- sampledata dataframe (sample-level metadata with named rows)33- metabolitedata dataframe (metabolite-level annotations with named rows)3435## How to apply3637Organize your metabolomics data into three linked dataframes: (1) featuredata: a matrix with unique sample names as row names and unique metabolite names as column names, containing peak intensities or concentrations; (2) sampledata: a dataframe with unique sample names as row names and columns for sample type, run order, batch assignment, and factors of interest; (3) metabolitedata: a dataframe with unique metabolite names as row names and columns for metabolite-specific annotations (e.g., internal/external standard designation, positive/negative control flags). Ensure row/column names are unique and consistent across dataframes. When using QC-based normalization (e.g., NormQcsamples), sort featuredata and sampledata by the run order column before function calls. Verify that all samples in featuredata have corresponding rows in sampledata and all metabolites have corresponding rows in metabolitedata.3839## Related tools4041- **NormalizeMets** (R package that consumes the three-part featuredata/sampledata/metabolitedata structure for normalization, QC assessment, and biomarker identification workflows) — https://github.com/metabolomicstats/NormalizeMets42- **R** (Programming environment for constructing and manipulating the dataframes; functions like data.frame(), row.names(), and merge() are used to organize and validate the structure)43- **RStudio** (IDE for interactive data inspection, validation, and debugging of the dataframe structure before passing to NormalizeMets functions)44- **Microsoft Excel** (Alternative interface (via ExNormalizeMets) for preparing and entering featuredata, sampledata, and metabolitedata prior to analysis in the NormalizeMets package)4546## Examples4748```49featuredata <- read.csv('peaks.csv', row.names=1); sampledata <- read.csv('samples.csv', row.names=1); metabolitedata <- read.csv('metabolites.csv', row.names=1); sampledata <- sampledata[order(sampledata$order), ]; featuredata <- featuredata[rownames(sampledata), ]50```5152## Evaluation signals5354- featuredata has unique, non-empty row names (sample identifiers) and column names (metabolite identifiers); no duplicate or missing names.55- sampledata has unique row names matching all samples in featuredata; contains 'order' column (run sequence) for QC-based normalization; all required grouping columns (batch, sample type) are present and non-empty.56- metabolitedata has unique row names matching all metabolites in featuredata; standard/control designations are explicitly recorded where applicable.57- Cross-reference validation: nrow(featuredata) == nrow(sampledata) and ncol(featuredata) == nrow(metabolitedata); rownames(featuredata) == rownames(sampledata) and colnames(featuredata) == rownames(metabolitedata).58- NormQcsamples or RlaPlots functions execute without errors related to missing or mismatched data; output plots and normalized matrices are produced with expected dimensions and metadata associations.5960## Limitations6162- The package requires R version 3.4.3 or higher; older R installations will not support NormalizeMets or its dataframe operations.63- Missing values (NA, NaN) in featuredata require explicit handling via the MissingValues() function before normalization; the structure itself does not automatically impute or handle gaps.64- The sampledata 'order' column must reflect the actual run sequence and be numeric and sorted before calling QC-based normalization functions; inconsistent ordering will produce incorrect batch corrections.65- Metabolite names and sample names must be unique within their respective dataframes; duplicate identifiers will cause indexing failures and incorrect cross-referencing across featuredata, sampledata, and metabolitedata.6667## Evidence6869- [readme] Input data format requirement: "The input data format consists of three parts: (i) "featuredata" which is the metabolomics data matrix containing all metabolite peak intensities (or concentrations). Unique sample names must be"70- [other] Sorting by run order for QC normalization: "Sort featuredata and sampledata by run order (sampledata$order column)."71- [readme] Sample metadata content specification: ""sampledata" is a dataframe that contains sample-specific information. These information can include sample type, order of analysis, factors of interest and other sample-specific data relevant to the"72- [readme] Metabolite annotation content specification: ""metabolitedata" contains metabolite-specific information in a separate dataframe. These information can include, but is not limited to, designation of metabolites as internal/external standards, or"73- [readme] Name consistency across dataframes: "Unique sample names must be provided as row names and unique metabolite names as column names"
HolobiomicsLab 