Syn Spark Dataframe

Operate, configure, troubleshoot, and manage Apache Spark. Use for Apache Spark engineering tasks, day-to-day operations, and production support.

legendtkl fe4310d 779 B Updated

File contents

Apache Spark: DataFrame transformations

When to use

Use this skill for DataFrame transformations in Apache Spark. This skill specifically handles DataFrame transformations and nothing else in the Apache Spark family.

Procedure

Build DataFrame pipelines with select/withColumn/groupBy, use built-in functions over UDFs, and chain transformations lazily.

Notes

This is the Apache Spark skill dedicated to DataFrame transformations. Sibling skills cover other Apache Spark capabilities; this one is the right choice only when the task is about DataFrame transformations.

legendtkl/agentic-skill-router/tree/main/experiments/dci-compare/synthetic-skills/syn-spark-dataframe commit fe4310d57c

Frequently asked questions

npx skillmds@latest add legendtkl/syn-spark-dataframe