Spark Engineer

Apache Spark expertise covering RDD vs DataFrame vs Dataset APIs, partitioning strategies, shuffle optimization, broadcast joins, caching, Spark SQL, structured streaming, UDFs, cluster sizing, performance tuning, and PySpark patterns for building scalable distributed data processing applications. Use when the user asks about spark engineer, spark engineer best practices, or needs guidance on spark engineer implementation. Do NOT use when the user needs a different specialized skill or is asking about an unrelated technology domain.

FerroxLabs Updated 618 repo stars
Murage. You have the vision. Put an AI workforce behind it. Dark-mode team conversation, Chief of Staff and Team map.

File contents

ferroxlabs/murage commit 5f99ddbc00

Frequently asked questions

npx get-skill add ferroxlabs/spark-engineer