ENGINEERING

Block Vercel promotion when a new release's crash-free rate dips

Watches Sentry release-health for a freshly deployed Vercel release and, if the crash-free sessions rate falls below your threshold during the bake window, halts the production…

CategoryEngineering
Enginesim
Difficultyintermediate
Triggerwebhook
Steps5
Setup~15 min

How it runs

The automated pipeline, trigger to output.

  • TriggerVercel deployment-ready webhookVercelVercel
  • ActionQuery Sentry crash-free sessions rate for the releaseSentrySentry
  • LogicCompare rate to threshold with minimum session sample
  • ActionHalt or roll back the Vercel promotion if unhealthyVercelVercel
  • OutputPost version, rate, and action to on-call Slack channelSlack

What it does

Gates a Vercel production promotion on real release-health signal. When a new release finishes its bake period, this checks Sentry's crash-free sessions rate and either lets the promotion stand or pulls it back before it reaches all users.

When to use it

Run this when you use Vercel skew protection or staged promotion and want a hard quality gate instead of eyeballing dashboards. Ideal for teams shipping multiple times a day who can't manually babysit every release.

How it works

  1. 1A Vercel deployment-ready webhook fires with the new release version and deployment ID.
  2. 2The flow waits out the configured bake window, then queries Sentry release-health for that version's crash-free sessions rate and session count.
  3. 3A branch compares the rate against your threshold (and requires a minimum session sample so noise doesn't trip it).
  4. 4If healthy, the promotion proceeds untouched. If the rate dips, the flow calls the Vercel API to halt or roll back the promotion.
  5. 5A Slack message to on-call summarizes the version, the measured rate, and the action taken.

Set it up

What you configure once, before turning it on.

  1. 1
    Connect VercelDeploys, runtime logs, analytics.
  2. 2
    Connect SentryErrors, performance, releases.
  3. 3
    Connect SlackChannels, DMs, threads, mentions.
  4. 4
    Set each agent's modelWe leave models unset so you pick the tier — fast + cheap, or top-quality.
  5. 5
    Tune it to your dataEdit the prompts, filters, and field mappings so it matches how your team works.
  6. 6
    Test, then turn it onRun once against a sample, confirm the output, then enable the trigger.

Run this workflow in your colony.

14-day trial. No DevOps. No Sales call. Provisioned in under a minute.