SECOPS

Datadog audit-event spike to PagerDuty escalation

Watches the Datadog audit trail for bursts of sensitive admin events (user role grants, API key creation, monitor deletions) and, when a burst crosses threshold, opens…

CategorySecOps
Enginesim
Difficultyintermediate
Triggerschedule
Steps5
Setup~15 min

How it runs

The automated pipeline, trigger to output.

  • TriggerEvery 5 minutes (scheduled)
  • ActionQuery Datadog audit events for recent windowDatadogDatadog
  • LogicGroup by actor and count sensitive actions
  • LogicBranch: any actor over burst threshold?
  • OutputOpen PagerDuty incident with burst summaryPagerDutyPagerDuty

What it does

It continuously evaluates the Datadog audit event stream, detects when a single actor performs an unusual burst of privileged actions in a short window, and escalates that burst as a PagerDuty incident so on-call can intervene before damage spreads.

When to use it

Reach for this when a compromised or rogue Datadog admin is your concern — for example mass role grants, bulk monitor deletions, or rapid API key minting. It turns 'noticed it next morning' into 'paged within minutes.'

How it works

  1. 1A scheduled trigger runs every 5 minutes.
  2. 2The flow queries the Datadog audit events API for the recent window.
  3. 3Events are grouped by actor and counted against per-action thresholds (e.g. 3+ role grants or any monitor deletion).
  4. 4A decision step checks whether any actor's burst crosses the threshold.
  5. 5If clear, the run ends quietly; if a spike is found, it builds an incident summary with actor, action counts, and timestamps.
  6. 6A PagerDuty incident is created at the matching severity and assigned to the security on-call schedule.

Set it up

What you configure once, before turning it on.

  1. 1
    Connect DatadogMetrics, traces, log search.
  2. 2
    Connect PagerDutyIncidents, on-call, escalations.
  3. 3
    Set each agent's modelWe leave models unset so you pick the tier — fast + cheap, or top-quality.
  4. 4
    Tune it to your dataEdit the prompts, filters, and field mappings so it matches how your team works.
  5. 5
    Test, then turn it onRun once against a sample, confirm the output, then enable the trigger.

Run this workflow in your colony.

14-day trial. No DevOps. No Sales call. Provisioned in under a minute.