DATA OPS

ELT pipeline-finished webhook to Datadog event and Teams alert

When your orchestrator posts its nightly run-finished webhook, this records the outcome as a Datadog event for trend tracking and, on any failed or skipped model.

CategoryData Ops
Enginesim
Difficultyintermediate
Triggerwebhook
Steps5
Setup~15 min

How it runs

The automated pipeline, trigger to output.

  • TriggerOrchestrator run-finished webhookHTTP webhook
  • LogicParse run summary and failed models
  • ActionEmit Datadog event with status tagsDatadogDatadog
  • LogicBranch on failed or skipped models
  • OutputPost failure detail to TeamsMicrosoft Teams

What it does

Turns your ELT orchestrator's end-of-run webhook into observable signal. It parses the run summary (success/error/skip counts and per-model results), emits a structured Datadog event tagged by run status and environment so you can chart failure rates over time, and on failure pushes a Teams message naming the failed models and their first-line errors.

When to use it

Use it when your scheduler reports run results via webhook but nobody watches its UI. You want failures in the channel the team already lives in, plus a Datadog timeline to spot "this model fails twice a week" patterns.

How it works

  1. 1The orchestrator's run-finished webhook triggers the flow with the run payload.
  2. 2A logic step parses the summary into pass/fail/skip and a list of failed model names.
  3. 3A Datadog event is emitted with status tags and counts for dashboards and monitors.
  4. 4A branch checks whether any model failed or was skipped.
  5. 5On failure, a Teams alert is posted with the failed models and their error snippets.

Set it up

What you configure once, before turning it on.

  1. 1
    Connect HTTP webhookTrigger any URL on agent actions.
  2. 2
    Connect DatadogMetrics, traces, log search.
  3. 3
    Connect Microsoft TeamsChannels, chats, files.
  4. 4
    Set each agent's modelWe leave models unset so you pick the tier — fast + cheap, or top-quality.
  5. 5
    Tune it to your dataEdit the prompts, filters, and field mappings so it matches how your team works.
  6. 6
    Test, then turn it onRun once against a sample, confirm the output, then enable the trigger.

Run this workflow in your colony.

14-day trial. No DevOps. No Sales call. Provisioned in under a minute.