DEVOPS

Vercel Preview Error-Watch Rollup Gate

After a Vercel preview deploys, exercises the preview with smoke traffic, watches Sentry for new errors triggered against that release.

CategoryDevOps
Enginesim
Difficultyadvanced
Triggerwebhook
Steps5
Setup~25 min

How it runs

The automated pipeline, trigger to output.

  • TriggerVercel preview deployment succeededVercelVercel
  • ActionDrive smoke traffic across preview routesHTTP webhook
  • ActionQuery Sentry for issues on this releaseSentrySentry
  • LogicPass/fail on presence of new errors
  • OutputPost error rollup and set error-watch commit statusGitHubGitHub

What it does

Catches runtime errors a preview only surfaces under traffic. The workflow pings the preview's main routes to generate activity, waits a short window, then queries Sentry for issues tagged to that preview release. Any new, unresolved errors become a blocking PR comment listing the exception, count, and stack link so the author can fix before merge.

When to use it

Use it when build-green and smoke-200 still let runtime exceptions slip through, especially for code paths that only throw when actually invoked. Requires Sentry releases tagged with the preview's commit SHA.

How it works

  1. 1Vercel sends a deployment-succeeded webhook for a preview build with its commit SHA.
  2. 2An HTTP step drives smoke traffic across the preview's key routes.
  3. 3Sentry is queried for issues scoped to the matching release after a short settle window.
  4. 4Logic decides pass or fail based on whether any new unresolved errors exist.
  5. 5GitHub gets an `error-watch` commit status and, on failure, a rollup comment of the new exceptions with links into Sentry.

Set it up

What you configure once, before turning it on.

  1. 1
    Connect VercelDeploys, runtime logs, analytics.
  2. 2
    Connect HTTP webhookTrigger any URL on agent actions.
  3. 3
    Connect SentryErrors, performance, releases.
  4. 4
    Connect GitHubRepos, issues, pull requests, actions.
  5. 5
    Set each agent's modelWe leave models unset so you pick the tier — fast + cheap, or top-quality.
  6. 6
    Tune it to your dataEdit the prompts, filters, and field mappings so it matches how your team works.
  7. 7
    Test, then turn it onRun once against a sample, confirm the output, then enable the trigger.

Run this workflow in your colony.

14-day trial. No DevOps. No Sales call. Provisioned in under a minute.