Glue

Glue

datus glue operates the AWS Glue Data Catalog, crawlers and ETL jobs through boto3. Global usage:

datus glue [--profile <env>] <group> <subcommand> [args...]

Add -o json to any read command for full output. Crawler runs only touch the catalog; job runs write data and are billed — they always require confirmation when run by the agent.

Catalog

datus glue catalog databases [--limit N]
datus glue catalog tables <db> [-e EXPR] [--limit N]
datus glue catalog show <db> <table>        # rendered schema: columns, partitions, location, format
datus glue catalog search <keyword>
datus glue catalog partitions <db> <table> [-e EXPR]
datus glue catalog versions <db> <table>
datus glue catalog stats <db> <table> [-c COLUMN ...]

Mutations (always confirmed; deletes prompt unless -y):

datus glue catalog create-database <name> [--description ...]
datus glue catalog delete-database <name> -y
datus glue catalog create-table|update-table <db> --table-input '<TableInput JSON>'
datus glue catalog delete-table <db> <table> -y
datus glue catalog add-partition <db> <table> --partition-input '<PartitionInput JSON>'
datus glue catalog delete-partition <db> <table> --values '["2026","07"]' -y

Crawlers

datus glue crawlers list | get <name> | status <name>
datus glue crawlers run <name> [--wait]      # start a crawl (catalog only)
datus glue crawlers stop <name>
datus glue crawlers history <name> [--limit N]
datus glue crawlers metrics [<name> ...]
datus glue crawlers schedule-pause|schedule-resume <name>

run --wait polls until the crawl returns to READY; exit 1 if the last crawl FAILED.

Jobs

datus glue jobs list | get <name>
datus glue jobs run <name> [--args '{"--key":"value"}'] [--wait]
datus glue jobs run-status <name> <run-id>
datus glue jobs runs <name> [--state FAILED] [--limit N]
datus glue jobs stop <name> <run-id> ...
datus glue jobs logs <name> <run-id> [--error]     # reads /aws-glue/jobs/output|error
datus glue jobs bookmark-reset <name>              # causes reprocessing

run --wait polls until the run is terminal: exit 0 on SUCCEEDED, 1 otherwise. Debug flow: jobs runs <name> --state FAILED → jobs logs <name> <run-id> --error → fix → jobs run <name> --wait.

Connections

datus glue connections list
datus glue connections get <name> [--show-secrets]   # passwords masked by default

Exit codes

0 success · 1 runtime/API error (also: failed run/crawl under --wait) · 2 usage · 3 config error.