Databricks Streaming Reliability

Use this skill to verify Structured Streaming query correctness and recovery: state-schema immutability, checkpoint compatibility across restarts, watermark semantics, trigger selection (AvailableNow, Once, ProcessingTime), exactly-once vs at-least-once sinks, foreachBatch idempotency, RocksDB and changelog checkpointing, serverless constraints, and restart/backfill safety. Reads query source, state schema, and checkpoint configuration only; never executes queries and never assumes DBR version features without verification.

VincentChuWaiChow Updated 24 repo stars

File contents

VincentChuWaiChow/vanguard-frontier-agentic commit 51b9d2edba

Frequently asked questions

npx get-skill add vincentchuwaichow/databricks-streaming-reliability