Parquet Column Mapper

Reads and transforms Apache Parquet file metadata and column statistics using PyArrow and the Parquet Thrift specification. Maps column types across Delta Lake, Iceberg, and Hudi table formats.

agentskillexchange Updated 28 repo stars

File contents

Parquet Column Mapper

Reads and transforms Apache Parquet file metadata and column statistics using PyArrow and the Parquet Thrift specification. Maps column types across Delta Lake, Iceberg, and Hudi table formats.

Installation

Use the upstream install or setup path that matches your environment:

  • $ npm install parquetjs

Requirements and caveats from upstream:

  • This project requires a major overhaul, as well as handling and sorting through dozens of issues and prs.
  • fully asynchronous, pure node.js implementation of the Parquet file format
  • To use parquet.js with node.js, install it using npm:

Basic usage or getting-started notes:



Source

agentskillexchange/skills/tree/main/skills/parquet-column-mapper commit 0331d78db4

Frequently asked questions

npx skillmds@latest add agentskillexchange/parquet-column-mapper