Pyspark Etl

Use when designing, implementing, reviewing, or optimizing production PySpark ETL/DataFrame pipelines at GB-TB+ scale, including schemas, joins, partitioning, window functions, writes, UDF avoidance, and Spark performance diagnostics.

ivanshamaev Updated 24 repo stars

File contents

ivanshamaev/de-agent-skills commit d45d95d45a

Frequently asked questions

npx get-skill add ivanshamaev/pyspark-etl