DATA OPS
BigQuery Scheduled-Query Daily Health Digest
Once each morning it compiles every scheduled query's last-run status, duration, and bytes processed into a single digest table and posts a ranked summary so the data team has…
How it runs
The automated pipeline, trigger to output.
- TriggerDaily before standup
- ActionQuery 24h job historyBigQuery
- LogicAggregate health metrics per query
- ActionWrite digest to history tableBigQuery
- OutputPost daily digest to SlackSlack
What it does
It produces a single daily rollup of the health of all scheduled queries in a project: pass/fail counts, the slowest jobs, the most expensive jobs, and any that didn't run at all. It replaces clicking through the BigQuery console with one readable report.
When to use it
Use it for a calm, scheduled morning review rather than real-time paging. Good for a data team that wants a standing health snapshot and a record they can scroll back through, without noise for every transient blip.
How it works
- 1A daily schedule fires before standup.
- 2A BigQuery action queries the last 24 hours of `INFORMATION_SCHEMA.JOBS` joined against the list of active transfer configs.
- 3A logic step aggregates per query: final state, duration, bytes billed, and whether an expected run is missing.
- 4A BigQuery action writes the rollup into a dated history table for trend tracking.
- 5A Slack output posts the digest with success/fail tallies and the top slowest and costliest queries linked to the console.
Set it up
What you configure once, before turning it on.
- 1Connect BigQueryDatasets, queries, schemas.
- 2Connect SlackChannels, DMs, threads, mentions.
- 3Set each agent's modelWe leave models unset so you pick the tier — fast + cheap, or top-quality.
- 4Tune it to your dataEdit the prompts, filters, and field mappings so it matches how your team works.
- 5Test, then turn it onRun once against a sample, confirm the output, then enable the trigger.
More Data Ops workflows
Weekly BigQuery Cost Trend Sheet and Exec Digest
Compiles week-over-week BigQuery scheduled-query cost by owner and dataset into a Google Sheet with trend columns.
Daily BigQuery Scheduled-Query Cost Attribution to Owners
Each morning, totals the prior day's on-demand bytes-billed per scheduled query, maps each query to its owner from a label, and posts a per-owner cost leaderboard to Slack.
BigQuery Per-Team Budget Breach Alert to PagerDuty
Tracks month-to-date BigQuery scheduled-query spend per team and, when a team crosses its monthly budget, pages the team's on-call in PagerDuty and snapshots the spend breakdown…
dbt source freshness watcher with severity-routed alerts
Checks Snowflake loaded-at timestamps against each dbt source's freshness SLA, then routes warnings to Slack and hard breaches to a PagerDuty incident so stale data never…
dbt orphan model detector with Linear cleanup tickets
Scans your dbt manifest for models that no other model, exposure, or BI tool consumes.
Raw Sensor Telemetry Archive to BigQuery
Captures every incoming building sensor reading via webhook, normalizes the payload into a consistent schema.
Run it inside a business
This workflow drops into a full company template. Import the org, and this is one of the playbooks its agents run.
Run this workflow in your colony.
14-day trial. No DevOps. No Sales call. Provisioned in under a minute.