AI AGENTS

Sentry Release-Health Crash to PagerDuty + Repro MR

When a new release's crash-free rate drops below target, an agent reproduces the top new crash, opens a GitLab MR with a failing test.

CategoryAI Agents
EngineSim + Paperclip
Difficultyadvanced
Triggerevent
Steps6
Setup~25 min

How it runs

The automated pipeline, trigger to output.

  • TriggerSentry release crash-free rate drops below targetSentrySentry
  • ActionIdentify top new crash for the releaseSentrySentry
  • ActionReproduce and write failing test in shellShell
  • ActionOpen GitLab MR linking release and issueGitLabGitLab
  • LogicPage only if reproduced and above severity floor
  • OutputTrigger PagerDuty incident with MR attachedPagerDutyPagerDuty

What it does

Ties release health to on-call escalation. When Sentry reports a release's crash-free session rate falling below your threshold, the agent identifies the top new crash introduced by that release, reproduces it, writes a failing test, opens a GitLab MR, and pages on-call through PagerDuty with the MR and repro attached so the responder has a confirmed defect, not just a metric.

When to use it

Use it during active rollouts when a crash-free regression must wake someone, but you want them to receive a reproduced, test-backed bug instead of a bare alert.

How it works

  1. 1A Sentry release-health alert fires on a crash-free rate drop.
  2. 2The agent identifies the top new crash attributed to the failing release.
  3. 3It reproduces the crash in a shell sandbox and writes a failing test.
  4. 4The agent opens a GitLab MR linking the release and Sentry issue.
  5. 5Logic gate: page only if the crash reproduces and exceeds the severity floor.
  6. 6It triggers a PagerDuty incident with the MR link and repro summary attached.

Set it up

What you configure once, before turning it on.

  1. 1
    Connect SentryErrors, performance, releases.
  2. 2
    Connect ShellRun sandboxed commands inside the workspace.
  3. 3
    Connect GitLabRepos, MRs, pipelines, registry.
  4. 4
    Connect PagerDutyIncidents, on-call, escalations.
  5. 5
    Set each agent's modelWe leave models unset so you pick the tier — fast + cheap, or top-quality.
  6. 6
    Tune it to your dataEdit the prompts, filters, and field mappings so it matches how your team works.
  7. 7
    Test, then turn it onRun once against a sample, confirm the output, then enable the trigger.

Run this workflow in your colony.

14-day trial. No DevOps. No Sales call. Provisioned in under a minute.