# Access Spark History Server

> Access logs of Spark jobs from Spark History Server.

- Skill: `vsevolodbazhan/access-spark-history-server` (Agent Skill)
- Install (CLI): `npx skillmds@latest add vsevolodbazhan/access-spark-history-server`
- Raw SKILL.md: https://api.skillmd.com/api/skills/vsevolodbazhan/access-spark-history-server/raw
- Safety review: pending (external: skill-scanner PASS, skillspector PASS)
- Works with: Claude Code, Claude.ai, OpenAI Codex
- Category: Coding & Dev Tools
- Author: vsevolodbazhan (https://skillmd.com/u/vsevolodbazhan)
- Updated: 2026-09-22
- Page: https://skillmd.com/skills/vsevolodbazhan/access-spark-history-server

---


## Spark Version

3.5.3

## Finished and Ongoing Jobs

- Logs of finished jobs can be retrieved from the host `spark-logs.ap.eu-north-1.k8s.int.avs.io`.
- For ongoing jobs, forward port 4040 to localhost.

## Port Forwarding

- Find the running driver in the `kyuubi` Kubernetes namespace: `kubectl get pods -n kyuubi | grep driver`
- Then forward the port with `kubectl port-forward <driver> 4040:4040` to localhost.

## Accessing Logs

There are multiple ways to access logs. Each is listed below in order of preference:

- CLI app. Use `spark-history-cli --help` to see available commands.
- REST API.
- Computer use.