DEVOPS

Daily digest of the priciest BigQuery queries posted to Slack

Each morning queries INFORMATION_SCHEMA for yesterday's top jobs by bytes billed and posts a ranked Slack digest with cost, user, and a link to each query.

CategoryDevOps
Enginesim
Difficultybeginner
Triggerschedule
Steps4
Setup~5 min

How it runs

The automated pipeline, trigger to output.

  • TriggerDaily schedule
  • ActionQuery INFORMATION_SCHEMA.JOBS for yesterday's costsGoogle BigQueryBigQuery
  • LogicRank and keep top offenders over threshold
  • OutputPost ranked cost digest to SlackSlack

What it does

Once a day it reads BigQuery's job history, ranks the previous day's queries by bytes billed and estimated dollar cost, and posts the top offenders to a Slack channel. The team sees which queries, users, and scheduled jobs are driving spend without anyone logging into the console.

When to use it

Use it when you want a low-effort cost habit: a single channel where the data team reviews the worst queries each morning and decides what to tune. It surfaces trends a per-PR gate misses, like a cheap query that suddenly scans more after a table grows.

How it works

  1. 1A daily schedule triggers the flow each morning.
  2. 2A BigQuery query reads INFORMATION_SCHEMA.JOBS for the prior day, summing bytes billed per job.
  3. 3A logic step ranks jobs and keeps the top N over a cost threshold.
  4. 4The flow formats each row with user, table, bytes billed, and estimated cost.
  5. 5A ranked digest is posted to Slack with one line per offending query.

Set it up

What you configure once, before turning it on.

  1. 1
    Connect BigQueryDatasets, queries, schemas.
  2. 2
    Connect SlackChannels, DMs, threads, mentions.
  3. 3
    Set each agent's modelWe leave models unset so you pick the tier — fast + cheap, or top-quality.
  4. 4
    Tune it to your dataEdit the prompts, filters, and field mappings so it matches how your team works.
  5. 5
    Test, then turn it onRun once against a sample, confirm the output, then enable the trigger.

Run this workflow in your colony.

14-day trial. No DevOps. No Sales call. Provisioned in under a minute.