Smt E2e Dataflow Debugging

Debugs logical errors and data discrepancies in Dataflow templates by launching jobs via Terraform and comparing source (e.g. Cloud SQL) vs destination (e.g. Spanner) data. Use ONLY when the pipeline launches and runs to completion (terminal state) but exhibits data discrepancies or logical issues. Do NOT use for debugging template startup/runtime crashes or staging/building new templates.

GoogleCloudPlatform Updated 1.1k repo stars

File contents

googlecloudplatform/dataflowtemplates commit 429f8c03bf

Frequently asked questions

npx get-skill add googlecloudplatform/smt-e2e-dataflow-debugging