column-name-variant-matching
Summary
Matches metabolomics metadata column headers against lists of alternative column names and normalized variants using case-insensitive regex patterns to identify and standardize database-ID columns (e.g., m/z, HMDB_ID, PubChem_ID). This skill enables robust column discovery in heterogeneously formatted mwTab files where the same semantic column may appear under multiple naming conventions.
When to use
When processing mwTab metabolomics data files with variable column naming conventions (e.g., 'm/z', 'moverz', 'mz' for mass-to-charge ratio), you need to identify and standardize database-ID columns (HMDB, PubChem, KEGG) prior to populating the ColumnFinder mechanism or merging with external metabolite reference databases. Apply this skill before ValueMatcher filtering to ensure semantic columns are correctly detected regardless of capitalization, spacing, or abbreviation style.
When NOT to use
- Input column headers are already validated and standardized to a single canonical naming scheme — apply name matching only when heterogeneous naming is expected.
- You are matching on column values rather than column names — use ValueMatcher.series_match instead for database-ID format detection within a column's values.
- The mwTab file is missing the metadata section entirely — NameMatcher requires accessible column header dictionaries to operate.
Inputs
- mwTab metadata column headers (dict or list of strings)
- NameMatcher lists of alternative column names and normalized variants
- metadata dictionary from MWTabFile instance
Outputs
- Standardized column name mapping (dict: original_header → canonical_name)
- ColumnFinder dictionary with matched database-ID columns
- Boolean validation result (column found and normalized or not)
How to apply
Construct a NameMatcher instance by defining lists of alternative column names for each semantic column (e.g., ['m/z', 'moverz', 'mz']) and normalized variants, then use the make_list_regex helper function to generate case-insensitive regex patterns from these lists. Apply the NameMatcher.dict_match method to the actual column headers from your mwTab metadata section, passing the dictionary of column names as input. The dict_match method performs column-name matching operations and returns matched columns standardized to the NameMatcher's canonical form. Pair the validated NameMatcher with a ValueMatcher (which enforces database-ID format constraints) and assemble both into a ColumnFinder instance keyed by the standard column name (e.g., 'HMDB_ID'). This two-stage approach (name matching followed by value matching) ensures both syntactic and semantic validation before accepting a column as identified.
Related tools
- mwtab (Core library providing NameMatcher class, dict_match method, make_list_regex pattern generator, and MWTabFile data structure for reading mwTab metabolomics metadata) — https://github.com/MoseleyBioinformaticsLab/mwtab
- pandas (Tabular data manipulation for accessing and transforming column headers and metadata dictionaries from mwTab sections)
- Python (Programming language runtime (3.6+) for executing NameMatcher logic and regex operations)
Examples
from mwtab import NameMatcher, make_list_regex; nm = NameMatcher(make_list_regex(['m/z', 'moverz', 'mz']), 'm/z'); matched = nm.dict_match({'m/z': 0, 'intensity': 1, 'mZ': 2})
Evaluation signals
- NameMatcher.dict_match returns matched headers for all expected column name variants (e.g., 'm/z', 'moverz', 'mz' all map to the same canonical column)
- Matched column is standardized to the NameMatcher's standard_name attribute and can be looked up in the ColumnFinder dictionary
- Case-insensitive matching works: 'M/Z', 'M/z', and 'm/z' all produce the same standardized output
- Unrelated column headers do not match (false-positive rate = 0 for adjacent or similarly-named non-matching columns)
- ColumnFinder assembly succeeds when NameMatcher output is paired with corresponding ValueMatcher (e.g., for 'HMDB_ID' column: name matched AND value format validates)
Limitations
- NameMatcher operates only on column headers, not on cell values — columns with correct names but non-conformant database-ID values will pass name matching but may fail ValueMatcher validation.
- Regex patterns are case-insensitive but do not handle typos or phonetic variations (e.g., 'mz' matches but 'mass_charge' does not).
- The make_list_regex function requires explicit enumeration of all expected variants; novel or domain-specific naming conventions not in the variant list will not be detected.
- No changelog is available in the repository, so regression or breaking changes in NameMatcher behavior across mwtab versions may not be documented.
Evidence
- [other] NameMatcher uses its dict_match method to perform column-name matching operations, while ValueMatcher uses its series_match method to match column values, with both matcher types employed together in the ColumnFinder mechanism to populate the column_finders dictionary for database-ID columns such as PubChem/KEGG/HMDB.: "NameMatcher uses its dict_match method to perform column-name matching operations, while ValueMatcher uses its series_match method to match column values, with both matcher types employed together in"
- [other] Define NameMatcher with lists of alternative column names and normalized variants (e.g., 'm/z', 'moverz', 'mz') using make_list_regex to construct case-insensitive patterns.: "Define NameMatcher with lists of alternative column names and normalized variants (e.g., 'm/z', 'moverz', 'mz') using make_list_regex to construct case-insensitive patterns"
- [other] All NameMatcher attributes are lists of strings or lists of lists of strings and all are used in its only method, dict_match.: "All NameMatcher attributes are lists of strings or lists of lists of strings and all are used in its only method, dict_match"
- [other] Validate NameMatcher.dict_match method on test metabolite metadata column headers to confirm pattern matching.: "Validate NameMatcher.dict_match method on test metabolite metadata column headers to confirm pattern matching"
- [readme] The
mwtab package is a Python library that facilitates reading and writing files in mwTab format used by the Metabolomics Workbench_ for archival of Mass Spectrometry (MS) and Nuclear Magnetic Resonance (NMR) experimental data.: "The mwtab package is a Python library that facilitates reading and writing files in mwTab format used by the Metabolomics Workbench_ for archival of Mass Spectrometry (MS) and Nuclear"
1---2name: column-name-variant-matching3description: Use when when processing mwTab metabolomics data files with variable column naming conventions (e.4license: CC-BY-4.05---67# column-name-variant-matching89## Summary1011Matches metabolomics metadata column headers against lists of alternative column names and normalized variants using case-insensitive regex patterns to identify and standardize database-ID columns (e.g., m/z, HMDB_ID, PubChem_ID). This skill enables robust column discovery in heterogeneously formatted mwTab files where the same semantic column may appear under multiple naming conventions.1213## When to use1415When processing mwTab metabolomics data files with variable column naming conventions (e.g., 'm/z', 'moverz', 'mz' for mass-to-charge ratio), you need to identify and standardize database-ID columns (HMDB, PubChem, KEGG) prior to populating the ColumnFinder mechanism or merging with external metabolite reference databases. Apply this skill before ValueMatcher filtering to ensure semantic columns are correctly detected regardless of capitalization, spacing, or abbreviation style.1617## When NOT to use1819- Input column headers are already validated and standardized to a single canonical naming scheme — apply name matching only when heterogeneous naming is expected.20- You are matching on column values rather than column names — use ValueMatcher.series_match instead for database-ID format detection within a column's values.21- The mwTab file is missing the metadata section entirely — NameMatcher requires accessible column header dictionaries to operate.2223## Inputs2425- mwTab metadata column headers (dict or list of strings)26- NameMatcher lists of alternative column names and normalized variants27- metadata dictionary from MWTabFile instance2829## Outputs3031- Standardized column name mapping (dict: original_header → canonical_name)32- ColumnFinder dictionary with matched database-ID columns33- Boolean validation result (column found and normalized or not)3435## How to apply3637Construct a NameMatcher instance by defining lists of alternative column names for each semantic column (e.g., ['m/z', 'moverz', 'mz']) and normalized variants, then use the make_list_regex helper function to generate case-insensitive regex patterns from these lists. Apply the NameMatcher.dict_match method to the actual column headers from your mwTab metadata section, passing the dictionary of column names as input. The dict_match method performs column-name matching operations and returns matched columns standardized to the NameMatcher's canonical form. Pair the validated NameMatcher with a ValueMatcher (which enforces database-ID format constraints) and assemble both into a ColumnFinder instance keyed by the standard column name (e.g., 'HMDB_ID'). This two-stage approach (name matching followed by value matching) ensures both syntactic and semantic validation before accepting a column as identified.3839## Related tools4041- **mwtab** (Core library providing NameMatcher class, dict_match method, make_list_regex pattern generator, and MWTabFile data structure for reading mwTab metabolomics metadata) — https://github.com/MoseleyBioinformaticsLab/mwtab42- **pandas** (Tabular data manipulation for accessing and transforming column headers and metadata dictionaries from mwTab sections)43- **Python** (Programming language runtime (3.6+) for executing NameMatcher logic and regex operations)4445## Examples4647```48from mwtab import NameMatcher, make_list_regex; nm = NameMatcher(make_list_regex(['m/z', 'moverz', 'mz']), 'm/z'); matched = nm.dict_match({'m/z': 0, 'intensity': 1, 'mZ': 2})49```5051## Evaluation signals5253- NameMatcher.dict_match returns matched headers for all expected column name variants (e.g., 'm/z', 'moverz', 'mz' all map to the same canonical column)54- Matched column is standardized to the NameMatcher's standard_name attribute and can be looked up in the ColumnFinder dictionary55- Case-insensitive matching works: 'M/Z', 'M/z', and 'm/z' all produce the same standardized output56- Unrelated column headers do not match (false-positive rate = 0 for adjacent or similarly-named non-matching columns)57- ColumnFinder assembly succeeds when NameMatcher output is paired with corresponding ValueMatcher (e.g., for 'HMDB_ID' column: name matched AND value format validates)5859## Limitations6061- NameMatcher operates only on column headers, not on cell values — columns with correct names but non-conformant database-ID values will pass name matching but may fail ValueMatcher validation.62- Regex patterns are case-insensitive but do not handle typos or phonetic variations (e.g., 'mz' matches but 'mass_charge' does not).63- The make_list_regex function requires explicit enumeration of all expected variants; novel or domain-specific naming conventions not in the variant list will not be detected.64- No changelog is available in the repository, so regression or breaking changes in NameMatcher behavior across mwtab versions may not be documented.6566## Evidence6768- [other] NameMatcher uses its dict_match method to perform column-name matching operations, while ValueMatcher uses its series_match method to match column values, with both matcher types employed together in the ColumnFinder mechanism to populate the column_finders dictionary for database-ID columns such as PubChem/KEGG/HMDB.: "NameMatcher uses its dict_match method to perform column-name matching operations, while ValueMatcher uses its series_match method to match column values, with both matcher types employed together in"69- [other] Define NameMatcher with lists of alternative column names and normalized variants (e.g., 'm/z', 'moverz', 'mz') using make_list_regex to construct case-insensitive patterns.: "Define NameMatcher with lists of alternative column names and normalized variants (e.g., 'm/z', 'moverz', 'mz') using make_list_regex to construct case-insensitive patterns"70- [other] All NameMatcher attributes are lists of strings or lists of lists of strings and all are used in its only method, dict_match.: "All NameMatcher attributes are lists of strings or lists of lists of strings and all are used in its only method, dict_match"71- [other] Validate NameMatcher.dict_match method on test metabolite metadata column headers to confirm pattern matching.: "Validate NameMatcher.dict_match method on test metabolite metadata column headers to confirm pattern matching"72- [readme] The ``mwtab`` package is a Python library that facilitates reading and writing files in ``mwTab`` format used by the `Metabolomics Workbench`_ for archival of Mass Spectrometry (MS) and Nuclear Magnetic Resonance (NMR) experimental data.: "The ``mwtab`` package is a Python library that facilitates reading and writing files in ``mwTab`` format used by the `Metabolomics Workbench`_ for archival of Mass Spectrometry (MS) and Nuclear"
HolobiomicsLab 