ENGINEERING

Escalate a severe crash-free regression to PagerDuty and flag rollback on Vercel

When a new Sentry release's crash-free rate falls far below baseline, opens a PagerDuty incident for the on-call and posts an urgent rollback-recommended comment on the Vercel…

CategoryEngineering
Enginesim
Difficultyintermediate
Triggerevent
Steps5
Setup~15 min

How it runs

The automated pipeline, trigger to output.

  • TriggerSentry release-health event for new deploySentrySentry
  • ActionFetch new vs baseline crash-free rateSentrySentry
  • LogicCheck drop against severe rollback threshold
  • ActionOpen PagerDuty incident for release on-callPagerDutyPagerDuty
  • OutputPost urgent rollback comment on Vercel deploymentVercelVercel

What it does

Handles the serious case, not the borderline one. This workflow watches new Sentry releases and reacts only when the crash-free rate drops sharply below baseline, past a severe threshold. At that point it pages the on-call through PagerDuty and posts an urgent comment on the Vercel deployment recommending immediate rollback, so a bad release gets human eyes within minutes.

When to use it

Use it as the high-severity tier of your release gate, separate from routine promote/hold logic. Reserve it for regressions big enough to warrant waking someone, so PagerDuty stays meaningful and the rollback signal isn't lost in chat.

How it works

  1. 1Sentry emits a release-health event for the new deploy.
  2. 2The flow fetches the new release's crash-free rate and the baseline from Sentry.
  3. 3A logic step checks whether the drop crosses the severe rollback threshold.
  4. 4If it does, it triggers a PagerDuty incident routed to the release on-call.
  5. 5It posts an urgent rollback-recommended comment on the Vercel deployment with the crash-free figures attached.

Set it up

What you configure once, before turning it on.

  1. 1
    Connect SentryErrors, performance, releases.
  2. 2
    Connect PagerDutyIncidents, on-call, escalations.
  3. 3
    Connect VercelDeploys, runtime logs, analytics.
  4. 4
    Set each agent's modelWe leave models unset so you pick the tier — fast + cheap, or top-quality.
  5. 5
    Tune it to your dataEdit the prompts, filters, and field mappings so it matches how your team works.
  6. 6
    Test, then turn it onRun once against a sample, confirm the output, then enable the trigger.

Run this workflow in your colony.

14-day trial. No DevOps. No Sales call. Provisioned in under a minute.