# Spark Troubleshooting

> Troubleshoot Spark applications on AWS EMR, Glue, and SageMaker - analyze failures, identify bottlenecks, get code recommendations. Use when mentioning Spark, EMR, PySpark, Glue Spark, or Spark troubleshooting.

- Skill: `whchoi98/spark-troubleshooting` (Agent Skill)
- Install (CLI): `npx skillmds@latest add whchoi98/spark-troubleshooting`
- Raw SKILL.md: https://api.skillmd.com/api/skills/whchoi98/spark-troubleshooting/raw
- Safety review: pending
- Works with: Claude Code, Claude.ai, OpenAI Codex
- Category: DevOps & Infra
- Author: whchoi98 (https://skillmd.com/u/whchoi98)
- Updated: 2026-09-22
- Page: https://skillmd.com/skills/whchoi98/spark-troubleshooting

---


# Spark Troubleshooting Agent

## Key Capabilities
- Failure analysis for PySpark and Scala jobs
- Root cause identification via telemetry correlation
- Performance diagnostics and bottleneck detection
- Code recommendations and optimizations
- Supports EMR EC2, EMR Serverless, Glue, SageMaker

## MCP Servers
- sagemaker-unified-studio-mcp-troubleshooting — Failure analysis
- sagemaker-unified-studio-mcp-code-rec — Code recommendations

## Best Practices
- Provide specific identifiers (cluster ID, application ID, job ID)
- Describe symptoms clearly (observed vs expected)
- Include exact error messages
- Specify platform (EMR EC2, EMR Serverless, Glue, SageMaker)

## Setup
Requires CloudFormation stack deployment for IAM role. See AWS docs for setup.