Spark Serverless Reliability And State Management

Enforces timeout-aware rollbacks, resumable checkpoints, and orphan cleanup for serverless Spark workloads on AWS Lambda, Glue, and similar runtimes. Use when writing or reviewing Spark jobs in serverless environments, S3 checkpoint patterns, partial-failure recovery, or IceGuard-style state management.

vaquarkhan Updated 64 repo stars
Data Engineering Agent Skills

File contents

vaquarkhan/data-engineering-agent-skills commit b5d128e62e

Frequently asked questions

npx get-skill add vaquarkhan/spark-serverless-reliability-and-state-management