DEVOPS

Vercel Preview Agent Review Gate

Spins up an AI reviewer that reads the PR diff and exercises the matching Vercel preview in a browser.

CategoryDevOps
Enginepaperclip
Difficultyadvanced
Triggerwebhook
Steps5
Setup~25 min

How it runs

The automated pipeline, trigger to output.

  • TriggerVercel preview deployment succeededVercelVercel
  • ActionFetch PR diff and description for contextGitHubGitHub
  • ActionProbe changed surfaces in the preview browserBrowserbase
  • LogicReason to a pass/block verdict with rationale
  • OutputPost reasoned checklist and set agent-review statusGitHubGitHub

What it does

Adds an agentic QA reviewer to the preview gate. When a preview is ready, the agent pulls the PR diff for context, opens the preview in a browser to verify the changed surfaces actually behave, and reasons about whether the change is merge-safe. It writes a structured checklist (what it tested, what passed, what concerned it) to the PR and gates merge accordingly.

When to use it

Use it when checks need judgment a fixed script can't encode, like confirming a UI change matches its intent or that an edge case from the diff was handled. Pairs well with deterministic gates as a second, smarter pass.

How it works

  1. 1Vercel sends a deployment-succeeded webhook with the preview URL and commit SHA.
  2. 2The agent fetches the PR diff and description from GitHub to understand what changed.
  3. 3Using Browserbase, the agent navigates the preview and probes the surfaces the diff touched.
  4. 4The agent reasons over its observations to a pass or block verdict with rationale.
  5. 5GitHub receives a `agent-review` commit status and a written checklist comment explaining the decision.

Set it up

What you configure once, before turning it on.

  1. 1
    Connect VercelDeploys, runtime logs, analytics.
  2. 2
    Connect GitHubRepos, issues, pull requests, actions.
  3. 3
    Connect BrowserbaseHeadless browsers, sessions, replays.
  4. 4
    Set each agent's modelWe leave models unset so you pick the tier — fast + cheap, or top-quality.
  5. 5
    Tune it to your dataEdit the prompts, filters, and field mappings so it matches how your team works.
  6. 6
    Test, then turn it onRun once against a sample, confirm the output, then enable the trigger.

Run this workflow in your colony.

14-day trial. No DevOps. No Sales call. Provisioned in under a minute.