feature-table-comparison-analysis
Summary
Compare feature extraction outputs from metabolomic data under different peak-height thresholds to evaluate the tradeoff between true positive recovery and false positive suppression. This skill quantifies how mitigation strategies (e.g., 2× peak-height adjustment) affect feature table quality, stability, and crash likelihood.
When to use
Apply this skill after running Paramounter's peak-height optimization on XCMS CentWave–extracted metabolomic features when you need to decide whether to accept the optimized threshold (maximizing true positives) or apply a higher threshold to reduce false positives and software crashes. Use it specifically when comparing an optimized feature table against a mitigated (elevated threshold) variant to assess the cost–benefit of each approach for your downstream analysis.
When NOT to use
- Input is already a final, validated feature table — comparison analysis is a pre-validation step, not a post-hoc quality check.
- No optimized peak-height threshold has been computed by Paramounter yet — run Paramounter first before attempting comparison.
- The analysis goal does not require balancing true positive recovery against false positive suppression (e.g., if false positives are acceptable or true positive sensitivity is not a concern).
Inputs
- raw metabolomic data (NetCDF, mzML, or compatible format)
- XCMS CentWave feature extraction parameters
- Paramounter-computed optimized peak-height threshold
Outputs
- feature table extracted with optimized peak-height threshold (with true positive, false positive, and crash statistics)
- feature table extracted with mitigated (2×) peak-height threshold (with true positive, false positive, and crash statistics)
- comparative summary report quantifying tradeoffs between the two extraction strategies
How to apply
Load raw metabolomic data and run XCMS CentWave feature extraction with initial parameters. Use Paramounter to compute the optimized peak-height threshold that maximizes true positive feature count. Apply this optimized threshold to extract an initial feature set, producing the baseline feature table. Then multiply the optimized peak-height threshold by a mitigation factor (e.g., 2×) and re-extract features using the elevated threshold. Generate summary statistics for both tables, including counts of true positives, false positives, and extraction stability metrics (e.g., crash frequency). Compare the two feature tables side-by-side using these metrics to determine whether the gain in true positives from the optimized threshold justifies the higher false positive rate and crash risk, or whether the 2×-mitigated threshold provides acceptable tradeoffs for your analysis goals.
Related tools
- XCMS CentWave (performs initial feature extraction from raw metabolomic data; provides raw feature set for Paramounter optimization and re-extraction with mitigated thresholds)
- Paramounter (computes optimized peak-height threshold maximizing true positive features; enables threshold multiplication and re-extraction for mitigation comparison) — github.com/HuanLab/Paramounter
Evaluation signals
- Both feature tables (optimized and 2×-mitigated) are successfully generated from the same raw data using identical XCMS CentWave parameters except for peak-height threshold.
- Summary statistics are computed for each table, with explicit counts or proportions of true positives, false positives, and software crashes; the 2×-mitigated table shows lower false positive rate and crash likelihood than the optimized table.
- True positive count in the optimized table is equal to or greater than in the 2×-mitigated table, confirming the expected tradeoff direction.
- Comparison report is human-readable and presents metrics in comparable units (e.g., counts, percentages, or rates) to enable decision-making between the two strategies.
- Dereplication parameters (mzdiff tolerance) are held constant across both extractions so that threshold differences alone drive the observed feature table divergence.
Limitations
- True positive and false positive ground truth must be available (e.g., from validated metabolite libraries or orthogonal detection) to compute summary statistics; the workflow does not infer ground truth from the feature tables alone.
- The 2× mitigation factor is a heuristic starting point; optimal threshold multiplication may vary by dataset, instrument, or metabolite class and should be tuned empirically.
- Software crash likelihood is reported qualitatively or as a frequency count; causality between peak-height threshold and crashes cannot be established from this workflow alone without controlled experimentation.
- Dereplication-related signal loss (true positives removed due to mzdiff tolerance below the mass difference of co-eluting features) is a separate issue from peak-height optimization and requires independent mitigation (e.g., setting mzdiff to a negative value to disable dereplication).
Evidence
- [other] Paramounter tunes an optimized peak height to maximize true positive features, but users can mitigate the resulting higher false positive rate and crash likelihood by applying a higher peak height threshold, such as 2X the optimized peak height threshold.: "Paramounter tunes an optimized peak height to maximize true positive features, but users can mitigate the resulting higher false positive rate and crash likelihood by applying a higher peak height"
- [other] 1. Load raw metabolomic data and run XCMS CentWave feature extraction with initial parameters. 2. Use Paramounter to compute the optimized peak-height threshold that maximizes the count of true positive features. 3. Apply the optimized threshold to extract an initial feature set. 4. Multiply the optimized peak-height threshold by 2× as a mitigation factor. 5. Re-extract features using the elevated threshold and compare the false positive rate and crash likelihood against the non-mitigated result. 6. Output both feature tables (optimized and 2×-mitigated) with summary statistics on true positives, false positives, and extraction stability.: "1. Load raw metabolomic data and run XCMS CentWave feature extraction with initial parameters. 2. Use Paramounter to compute the optimized peak-height threshold that maximizes the count of true"
- [readme] Paramounter tunes an optimized peak height to maximize the number of true positive features. A drawback of that optimized value is the higher rate of false positive features and the likelihood of software crash.: "Paramounter tunes an optimized peak height to maximize the number of true positive features. A drawback of that optimized value is the higher rate of false positive features and the likelihood of"
- [readme] users can try a higher peak height threshold to reduce the number of false positive features (e.g., 2X the optimized peak height threshold).: "users can try a higher peak height threshold to reduce the number of false positive features (e.g., 2X the optimized peak height threshold)."
1---2name: feature-table-comparison-analysis3description: Use when after running Paramounter's peak-height optimization on XCMS CentWave–extracted metabolomic features when you need to decide whether to accept the optimized threshold (maximizing true positives) or apply a higher threshold to reduce false positives and software crashes.4license: CC-BY-4.05---67# feature-table-comparison-analysis89## Summary1011Compare feature extraction outputs from metabolomic data under different peak-height thresholds to evaluate the tradeoff between true positive recovery and false positive suppression. This skill quantifies how mitigation strategies (e.g., 2× peak-height adjustment) affect feature table quality, stability, and crash likelihood.1213## When to use1415Apply this skill after running Paramounter's peak-height optimization on XCMS CentWave–extracted metabolomic features when you need to decide whether to accept the optimized threshold (maximizing true positives) or apply a higher threshold to reduce false positives and software crashes. Use it specifically when comparing an optimized feature table against a mitigated (elevated threshold) variant to assess the cost–benefit of each approach for your downstream analysis.1617## When NOT to use1819- Input is already a final, validated feature table — comparison analysis is a pre-validation step, not a post-hoc quality check.20- No optimized peak-height threshold has been computed by Paramounter yet — run Paramounter first before attempting comparison.21- The analysis goal does not require balancing true positive recovery against false positive suppression (e.g., if false positives are acceptable or true positive sensitivity is not a concern).2223## Inputs2425- raw metabolomic data (NetCDF, mzML, or compatible format)26- XCMS CentWave feature extraction parameters27- Paramounter-computed optimized peak-height threshold2829## Outputs3031- feature table extracted with optimized peak-height threshold (with true positive, false positive, and crash statistics)32- feature table extracted with mitigated (2×) peak-height threshold (with true positive, false positive, and crash statistics)33- comparative summary report quantifying tradeoffs between the two extraction strategies3435## How to apply3637Load raw metabolomic data and run XCMS CentWave feature extraction with initial parameters. Use Paramounter to compute the optimized peak-height threshold that maximizes true positive feature count. Apply this optimized threshold to extract an initial feature set, producing the baseline feature table. Then multiply the optimized peak-height threshold by a mitigation factor (e.g., 2×) and re-extract features using the elevated threshold. Generate summary statistics for both tables, including counts of true positives, false positives, and extraction stability metrics (e.g., crash frequency). Compare the two feature tables side-by-side using these metrics to determine whether the gain in true positives from the optimized threshold justifies the higher false positive rate and crash risk, or whether the 2×-mitigated threshold provides acceptable tradeoffs for your analysis goals.3839## Related tools4041- **XCMS CentWave** (performs initial feature extraction from raw metabolomic data; provides raw feature set for Paramounter optimization and re-extraction with mitigated thresholds)42- **Paramounter** (computes optimized peak-height threshold maximizing true positive features; enables threshold multiplication and re-extraction for mitigation comparison) — github.com/HuanLab/Paramounter4344## Evaluation signals4546- Both feature tables (optimized and 2×-mitigated) are successfully generated from the same raw data using identical XCMS CentWave parameters except for peak-height threshold.47- Summary statistics are computed for each table, with explicit counts or proportions of true positives, false positives, and software crashes; the 2×-mitigated table shows lower false positive rate and crash likelihood than the optimized table.48- True positive count in the optimized table is equal to or greater than in the 2×-mitigated table, confirming the expected tradeoff direction.49- Comparison report is human-readable and presents metrics in comparable units (e.g., counts, percentages, or rates) to enable decision-making between the two strategies.50- Dereplication parameters (mzdiff tolerance) are held constant across both extractions so that threshold differences alone drive the observed feature table divergence.5152## Limitations5354- True positive and false positive ground truth must be available (e.g., from validated metabolite libraries or orthogonal detection) to compute summary statistics; the workflow does not infer ground truth from the feature tables alone.55- The 2× mitigation factor is a heuristic starting point; optimal threshold multiplication may vary by dataset, instrument, or metabolite class and should be tuned empirically.56- Software crash likelihood is reported qualitatively or as a frequency count; causality between peak-height threshold and crashes cannot be established from this workflow alone without controlled experimentation.57- Dereplication-related signal loss (true positives removed due to mzdiff tolerance below the mass difference of co-eluting features) is a separate issue from peak-height optimization and requires independent mitigation (e.g., setting mzdiff to a negative value to disable dereplication).5859## Evidence6061- [other] Paramounter tunes an optimized peak height to maximize true positive features, but users can mitigate the resulting higher false positive rate and crash likelihood by applying a higher peak height threshold, such as 2X the optimized peak height threshold.: "Paramounter tunes an optimized peak height to maximize true positive features, but users can mitigate the resulting higher false positive rate and crash likelihood by applying a higher peak height"62- [other] 1. Load raw metabolomic data and run XCMS CentWave feature extraction with initial parameters. 2. Use Paramounter to compute the optimized peak-height threshold that maximizes the count of true positive features. 3. Apply the optimized threshold to extract an initial feature set. 4. Multiply the optimized peak-height threshold by 2× as a mitigation factor. 5. Re-extract features using the elevated threshold and compare the false positive rate and crash likelihood against the non-mitigated result. 6. Output both feature tables (optimized and 2×-mitigated) with summary statistics on true positives, false positives, and extraction stability.: "1. Load raw metabolomic data and run XCMS CentWave feature extraction with initial parameters. 2. Use Paramounter to compute the optimized peak-height threshold that maximizes the count of true"63- [readme] Paramounter tunes an optimized peak height to maximize the number of true positive features. A drawback of that optimized value is the higher rate of false positive features and the likelihood of software crash.: "Paramounter tunes an optimized peak height to maximize the number of true positive features. A drawback of that optimized value is the higher rate of false positive features and the likelihood of"64- [readme] users can try a higher peak height threshold to reduce the number of false positive features (e.g., 2X the optimized peak height threshold).: "users can try a higher peak height threshold to reduce the number of false positive features (e.g., 2X the optimized peak height threshold)."
HolobiomicsLab