ENGINEERING

Audit runbook freshness for services that paged this week

Weekly, pulls services that triggered PagerDuty incidents in the last seven days, checks each one's Confluence runbook for recent edits.

CategoryEngineering
Enginesim
Difficultyintermediate
Triggerschedule
Steps5
Setup~15 min

How it runs

The automated pipeline, trigger to output.

  • TriggerWeekly schedule starts the audit
  • ActionPull last-7-day incidents grouped by service from PagerDutyPagerDutyPagerDuty
  • ActionRead each impacted service's runbook date from ConfluenceConfluenceConfluence
  • LogicKeep services with stale runbooks and score by incident count
  • OutputPost prioritized risk report to SlackSlack

What it does

Focuses runbook hygiene on the services that actually hurt. It gathers every service that opened a PagerDuty incident in the past week, then cross-references each against its Confluence runbook's last-updated date, producing a prioritized list of services that paged on-call while running on a stale runbook.

When to use it

Run it as a weekly on-call retro input. A runbook that is stale on a quiet service is low risk; a stale runbook on a service that paged three times last week is exactly where to spend a refresh hour. This workflow ranks by real incident pressure.

How it works

  1. 1A weekly schedule starts the audit.
  2. 2It queries PagerDuty for incidents in the trailing seven days and groups them by service.
  3. 3For each impacted service it reads the runbook's last-edited date from Confluence.
  4. 4A logic step retains only services whose runbook predates the incident window.
  5. 5It scores each by incident count so the riskiest land on top.
  6. 6The ranked report is posted to the on-call Slack channel for the retro.

Set it up

What you configure once, before turning it on.

  1. 1
    Connect PagerDutyIncidents, on-call, escalations.
  2. 2
    Connect ConfluenceSpaces, pages, blueprints.
  3. 3
    Connect SlackChannels, DMs, threads, mentions.
  4. 4
    Set each agent's modelWe leave models unset so you pick the tier — fast + cheap, or top-quality.
  5. 5
    Tune it to your dataEdit the prompts, filters, and field mappings so it matches how your team works.
  6. 6
    Test, then turn it onRun once against a sample, confirm the output, then enable the trigger.

Run this workflow in your colony.

14-day trial. No DevOps. No Sales call. Provisioned in under a minute.