DEVOPS

Page on-call when a Vercel preview breaks a critical path

Watches Vercel preview deployments, re-runs the critical-path smoke suite, and raises a PagerDuty incident plus a Slack alert only when a previously-passing path regresses.

CategoryDevOps
Enginesim
Difficultyintermediate
Triggerwebhook
Steps5
Setup~15 min

How it runs

The automated pipeline, trigger to output.

  • TriggerVercel preview deployment webhookVercelVercel
  • ActionRun critical-path smoke suite on previewBrowserbase
  • LogicDiff results against branch last-good baseline
  • ActionOpen PagerDuty incident on regressionPagerDutyPagerDuty
  • OutputMirror incident to Slack channelSlack

What it does

This workflow treats preview deployments as an early-warning system. After each preview deploy it runs the critical-path smoke suite, compares results to the last known-good run for that branch, and escalates only when a path that used to work now fails - reducing alert noise to genuine regressions.

When to use it

Use it on high-traffic projects where a regression caught at preview is far cheaper than one caught in production, and where the team already runs PagerDuty for on-call.

How it works

  1. 1A Vercel deployment webhook delivers the preview URL and branch.
  2. 2Browserbase runs the smoke suite against the preview and records per-path status.
  3. 3A logic step diffs the current results against the stored last-good baseline for the branch.
  4. 4If no path regressed, the run ends quietly and the baseline is updated.
  5. 5If a path regressed, a PagerDuty incident is opened with the failing path, branch, and screenshot.
  6. 6A Slack message mirrors the incident into the team channel for visibility.

Set it up

What you configure once, before turning it on.

  1. 1
    Connect VercelDeploys, runtime logs, analytics.
  2. 2
    Connect BrowserbaseHeadless browsers, sessions, replays.
  3. 3
    Connect PagerDutyIncidents, on-call, escalations.
  4. 4
    Connect SlackChannels, DMs, threads, mentions.
  5. 5
    Set each agent's modelWe leave models unset so you pick the tier — fast + cheap, or top-quality.
  6. 6
    Tune it to your dataEdit the prompts, filters, and field mappings so it matches how your team works.
  7. 7
    Test, then turn it onRun once against a sample, confirm the output, then enable the trigger.

Run this workflow in your colony.

14-day trial. No DevOps. No Sales call. Provisioned in under a minute.