DEVOPS

Archive Nightly Handoff Metrics to BigQuery

Each morning, rolls up the night's PagerDuty and Axiom incident data into structured rows, writes them to BigQuery for long-term on-call health tracking.

CategoryDevOps
Enginesim
Difficultyadvanced
Triggerschedule
Steps6
Setup~25 min

How it runs

The automated pipeline, trigger to output.

  • TriggerDaily schedule fires after overnight window
  • ActionFetch PagerDuty incidents and response timesPagerDutyPagerDuty
  • ActionQuery Axiom for off-hours alert volumeAxiom
  • LogicCompute rollup metrics and shape rows
  • ActionInsert rows into BigQuery metrics tableGoogle BigQueryBigQuery
  • OutputEmail daily snapshot to eng lead via GmailGmailGmail

What it does

This workflow treats the handoff as data, not just a message. Each morning it computes the night's on-call metrics — incident count, mean time to acknowledge, mean time to resolve, after-hours page count, and noisiest service — from PagerDuty and Axiom, appends them as structured rows in BigQuery, and emails a snapshot to the engineering lead. Over weeks this becomes a trend line for on-call burden.

When to use it

Use it when you need to measure and report on-call health over time — for staffing decisions, rotation fairness, or showing leadership that paging volume is trending down. It complements a human-readable handoff with durable metrics.

How it works

  1. 1A daily schedule fires after the overnight window closes.
  2. 2Fetch the night's incidents and response times from PagerDuty.
  3. 3Query Axiom for off-hours alert volume and error counts.
  4. 4A logic step computes the rollup metrics and shapes them into rows.
  5. 5Insert the rows into the BigQuery on-call metrics table.
  6. 6Email the daily snapshot to the engineering lead via Gmail.

Set it up

What you configure once, before turning it on.

  1. 1
    Connect PagerDutyIncidents, on-call, escalations.
  2. 2
    Connect AxiomLog streams, queries, dashboards.
  3. 3
    Connect BigQueryDatasets, queries, schemas.
  4. 4
    Connect GmailRead, draft, send, label.
  5. 5
    Set each agent's modelWe leave models unset so you pick the tier — fast + cheap, or top-quality.
  6. 6
    Tune it to your dataEdit the prompts, filters, and field mappings so it matches how your team works.
  7. 7
    Test, then turn it onRun once against a sample, confirm the output, then enable the trigger.

Run this workflow in your colony.

14-day trial. No DevOps. No Sales call. Provisioned in under a minute.