DEVOPS

Gate PR merges on preview-deploy error budget health

When a Vercel preview deploy is ready for a pull request, it runs synthetic traffic, checks Sentry for new errors on that preview release.

CategoryDevOps
Enginesim
Difficultyadvanced
Triggerwebhook
Steps6
Setup~25 min

How it runs

The automated pipeline, trigger to output.

  • TriggerVercel preview deployment ready for PRVercelVercel
  • ActionSend synthetic traffic to the preview URLHTTP webhook
  • ActionQuery Sentry for new issues on preview releaseSentrySentry
  • LogicDecide pass/fail on new errors
  • ActionPost commit status check to GitHub PRGitHubGitHub
  • OutputComment offending issues on the PR if failedGitHubGitHub

What it does

Stops regressions before they reach production by error-budget-testing the preview build. When a PR's Vercel preview deployment is ready, the flow exercises it, queries Sentry for any new issues tagged to that preview release, and reports a pass or fail back to the pull request as a commit status, blocking merge if the preview introduces fresh errors.

When to use it

Use it when you want error regressions caught at the PR stage instead of after production rollout, giving reviewers a reliability signal alongside CI and tests.

How it works

  1. 1A Vercel preview-deployment-ready webhook fires with the PR and preview URL.
  2. 2The flow sends synthetic requests to the preview URL to generate traffic.
  3. 3It queries Sentry for new issues attributed to the preview release.
  4. 4A branch decides pass or fail based on whether new errors appeared.
  5. 5It posts a commit status check back to the GitHub pull request.
  6. 6On failure it comments on the PR with the offending issues.

Set it up

What you configure once, before turning it on.

  1. 1
    Connect VercelDeploys, runtime logs, analytics.
  2. 2
    Connect SentryErrors, performance, releases.
  3. 3
    Connect GitHubRepos, issues, pull requests, actions.
  4. 4
    Connect HTTP webhookTrigger any URL on agent actions.
  5. 5
    Set each agent's modelWe leave models unset so you pick the tier — fast + cheap, or top-quality.
  6. 6
    Tune it to your dataEdit the prompts, filters, and field mappings so it matches how your team works.
  7. 7
    Test, then turn it onRun once against a sample, confirm the output, then enable the trigger.

Run this workflow in your colony.

14-day trial. No DevOps. No Sales call. Provisioned in under a minute.