DEVOPS

Block Vercel promotion when preview smoke checks fail

On every Vercel preview deployment, runs scripted browser smoke checks against the critical paths and posts a pass/fail gate to the PR so a broken preview can't be promoted…

CategoryDevOps
Enginesim
Difficultyintermediate
Triggerwebhook
Steps6
Setup~15 min

How it runs

The automated pipeline, trigger to output.

  • TriggerVercel preview deployment succeeded webhookVercelVercel
  • LogicFilter to preview-environment success events
  • ActionRun scripted critical-path smoke checks in headless browserBrowserbase
  • LogicAggregate path results into pass or fail
  • ActionSet GitHub commit status qa/smoke on the PRGitHubGitHub
  • OutputComment pass/fail with failing path and screenshot on PRGitHubGitHub

What it does

Every time Vercel finishes a preview deployment, this workflow drives a headless browser through your critical user paths (load homepage, sign in, reach checkout) against the fresh preview URL. If any path breaks, it marks the GitHub commit status red and comments the failure so the deploy can't be promoted.

When to use it

Use it when broken previews keep slipping to production because review is manual. It gives every PR an automatic, deterministic quality gate tied to the exact preview build.

How it works

  1. 1Vercel fires a deployment webhook carrying the preview URL and commit SHA.
  2. 2A filter passes only `deployment.succeeded` events targeting the preview environment.
  3. 3Browserbase opens the preview URL and walks each scripted critical path, capturing screenshots and assertions.
  4. 4A logic step aggregates results into pass or fail.
  5. 5The workflow sets a GitHub commit status (`qa/smoke`) and posts a PR comment with the screenshot and which path failed.
  6. 6On pass it sets the status green so promotion is unblocked.

Set it up

What you configure once, before turning it on.

  1. 1
    Connect VercelDeploys, runtime logs, analytics.
  2. 2
    Connect BrowserbaseHeadless browsers, sessions, replays.
  3. 3
    Connect GitHubRepos, issues, pull requests, actions.
  4. 4
    Set each agent's modelWe leave models unset so you pick the tier — fast + cheap, or top-quality.
  5. 5
    Tune it to your dataEdit the prompts, filters, and field mappings so it matches how your team works.
  6. 6
    Test, then turn it onRun once against a sample, confirm the output, then enable the trigger.

Run this workflow in your colony.

14-day trial. No DevOps. No Sales call. Provisioned in under a minute.