IT OPS

Draft an all-clear update when the underlying alert recovers

When the Datadog monitor that opened an incident recovers, this drafts a plain-language "resolved" update and routes it to Slack for a final human sign-off before closing…

CategoryIT Ops
Enginesim
Difficultyintermediate
Triggerwebhook
Steps5
Setup~15 min

How it runs

The automated pipeline, trigger to output.

  • TriggerDatadog monitor recovers to OKDatadogDatadog
  • LogicMatch recovery to an open public incident
  • ActionDraft plain-language all-clear messageOpenAI
  • ActionPost all-clear draft to Slack for sign-offSlack
  • OutputPublish resolution + close incident on status pageHTTP webhook

What it does

It handles the often-forgotten end of an incident: the all-clear. When the monitor that triggered an open incident returns to OK, the workflow drafts a calm, customer-readable resolution message ("This issue has been resolved and all systems are operating normally") and asks for one last human confirmation before marking the public incident resolved.

When to use it

Use it when incidents tend to linger as "open" on your status page long after the real problem is fixed, because nobody remembers to post the closing update. It pairs naturally with an alert-to-draft opener so the same incident is cleanly opened and closed.

How it works

  1. 1A Datadog monitor transitions from Alert back to OK and fires the workflow.
  2. 2A logic step matches the recovery to an open public incident; if none is open, it stops.
  3. 3An LLM step drafts a short resolution update referencing the original impact and confirming normal operation.
  4. 4The all-clear draft is posted to Slack for sign-off, with a button that publishes the resolution and closes the incident on the status page.

Set it up

What you configure once, before turning it on.

  1. 1
    Connect DatadogMetrics, traces, log search.
  2. 2
    Connect OpenAIModels, embeddings, files.
  3. 3
    Connect SlackChannels, DMs, threads, mentions.
  4. 4
    Connect HTTP webhookTrigger any URL on agent actions.
  5. 5
    Set each agent's modelWe leave models unset so you pick the tier — fast + cheap, or top-quality.
  6. 6
    Tune it to your dataEdit the prompts, filters, and field mappings so it matches how your team works.
  7. 7
    Test, then turn it onRun once against a sample, confirm the output, then enable the trigger.

Run this workflow in your colony.

14-day trial. No DevOps. No Sales call. Provisioned in under a minute.