DEVOPS

Datadog Alert to PagerDuty On-Call Triage

When a Datadog monitor fires, classify the alert by severity and service, page the right on-call rotation in PagerDuty, and open a triage thread in Slack.

CategoryDevOps
Enginesim
Difficultyintermediate
Triggerwebhook
Steps5
Setup~15 min

How it runs

The automated pipeline, trigger to output.

  • TriggerDatadog monitor alert receivedDatadogDatadog
  • LogicClassify severity and resolve owning on-call team
  • LogicDrop low-priority warnings, escalate P1/P2
  • ActionCreate PagerDuty incident on matched escalation policyPagerDutyPagerDuty
  • OutputOpen Slack triage thread tagging responderSlack

What it does

Turns a raw Datadog monitor alert into a routed, paged incident. It reads the alert's tags and priority, decides which team owns the affected service, and creates a PagerDuty incident on that team's escalation policy. It then opens a dedicated Slack thread so responders coordinate in one place instead of hunting through alert noise.

When to use it

Use this as the front door for production alerting when you have multiple services and on-call rotations and want every Datadog alert to reach exactly the right human within seconds, with full context attached.

How it works

  1. 1A Datadog monitor crosses its threshold and posts the alert webhook.
  2. 2Logic inspects the alert priority and `service`/`team` tags to pick a severity tier and owning rotation.
  3. 3Low-priority warnings are filtered out and only logged; P1/P2 alerts proceed.
  4. 4A PagerDuty incident is created against the matched escalation policy with the alert title, runbook link, and Datadog graph URL.
  5. 5A Slack message opens an incident thread tagging the paged responder and linking the PagerDuty incident for live coordination.

Set it up

What you configure once, before turning it on.

  1. 1
    Connect DatadogMetrics, traces, log search.
  2. 2
    Connect PagerDutyIncidents, on-call, escalations.
  3. 3
    Connect SlackChannels, DMs, threads, mentions.
  4. 4
    Set each agent's modelWe leave models unset so you pick the tier — fast + cheap, or top-quality.
  5. 5
    Tune it to your dataEdit the prompts, filters, and field mappings so it matches how your team works.
  6. 6
    Test, then turn it onRun once against a sample, confirm the output, then enable the trigger.

Run this workflow in your colony.

14-day trial. No DevOps. No Sales call. Provisioned in under a minute.