DATA OPS

BigQuery DDL Webhook Drift Triage with Agent Severity Call

Receives BigQuery audit-log DDL events via webhook in near real time, has an agent assess the change against the table's documented contract and downstream consumers.

CategoryData Ops
EngineSim + Paperclip
Difficultyadvanced
Triggerwebhook
Steps6
Setup~25 min

How it runs

The automated pipeline, trigger to output.

  • TriggerWebhook receives BigQuery DDL audit eventHTTP webhook
  • ActionFetch affected table schema and metadataGoogle BigQueryBigQuery
  • ActionAgent reads documented contract from NotionNotionNotion
  • LogicBranch on agent severity rating
  • ActionPage on-call for high-severity driftPagerDutyPagerDuty
  • OutputOpen ClickUp review task for lower-severity driftClickUpClickUp

What it does

It reacts to schema changes the moment they land instead of waiting for a nightly scan. A Cloud Logging sink posts BigQuery DDL audit events to a webhook. An agent reads the changed table's documented contract and its known downstream consumers, then judges severity: does this drop or retype a column something depends on? High-severity drift pages on-call; lower-severity drift opens a review task for the contract owner to confirm during business hours.

When to use it

Use it for high-traffic warehouse environments where waiting until the nightly run to learn about a breaking `ALTER TABLE` is too slow, and where a human judgment call on blast radius beats a rigid rule. Good for teams that already export BigQuery audit logs to a sink.

How it works

  1. 1A webhook receives a BigQuery DDL audit-log event.
  2. 2Fetch the affected table's current schema and metadata from BigQuery.
  3. 3The agent reads the documented contract from Notion and weighs downstream impact.
  4. 4Branch on the agent's severity rating.
  5. 5High severity pages on-call via PagerDuty.
  6. 6Lower severity opens a ClickUp review task with the agent's assessment.

Set it up

What you configure once, before turning it on.

  1. 1
    Connect HTTP webhookTrigger any URL on agent actions.
  2. 2
    Connect BigQueryDatasets, queries, schemas.
  3. 3
    Connect NotionPages, databases, comments.
  4. 4
    Connect PagerDutyIncidents, on-call, escalations.
  5. 5
    Connect ClickUpDocs + tasks + chats in one workspace.
  6. 6
    Set each agent's modelWe leave models unset so you pick the tier — fast + cheap, or top-quality.
  7. 7
    Tune it to your dataEdit the prompts, filters, and field mappings so it matches how your team works.
  8. 8
    Test, then turn it onRun once against a sample, confirm the output, then enable the trigger.

Run this workflow in your colony.

14-day trial. No DevOps. No Sales call. Provisioned in under a minute.