DEVOPS

Vercel Preview Smoke Gate with PR Checklist

When Vercel finishes a preview deployment for a pull request, runs a scripted set of HTTP smoke checks against the preview URL and posts a pass/fail checklist as a GitHub PR…

CategoryDevOps
Enginesim
Difficultyintermediate
Triggerwebhook
Steps5
Setup~15 min

How it runs

The automated pipeline, trigger to output.

  • TriggerVercel preview deployment succeededVercelVercel
  • LogicKeep only preview builds on an open PR
  • ActionRun HTTP smoke checks against preview URLHTTP webhook
  • LogicRoll checks into pass/fail verdict
  • OutputPost checklist comment and set qa-gate commit statusGitHubGitHub

What it does

Turns every Vercel preview into a self-testing gate. The moment a preview build goes live, this workflow hits the preview URL with a list of smoke checks (homepage 200, login route, health endpoint, a known API response) and writes the results back to the pull request as a tidy checklist comment plus a `qa-gate` commit status.

When to use it

Use it when a green Vercel build is not enough proof a branch is safe to merge and you want a fast, automated first pass before a human reviews. Best for teams that already require status checks on protected branches.

How it works

  1. 1Vercel fires a deployment-succeeded webhook carrying the preview URL and the source commit SHA.
  2. 2A filter keeps only `preview` deployments tied to an open PR and drops production builds.
  3. 3An HTTP step runs each smoke check against the preview URL and records status code and latency.
  4. 4Logic rolls the results into a single pass/fail verdict.
  5. 5A GitHub action posts the checklist comment and sets the `qa-gate` commit status to success or failure, which the branch protection rule enforces at merge time.

Set it up

What you configure once, before turning it on.

  1. 1
    Connect VercelDeploys, runtime logs, analytics.
  2. 2
    Connect HTTP webhookTrigger any URL on agent actions.
  3. 3
    Connect GitHubRepos, issues, pull requests, actions.
  4. 4
    Set each agent's modelWe leave models unset so you pick the tier — fast + cheap, or top-quality.
  5. 5
    Tune it to your dataEdit the prompts, filters, and field mappings so it matches how your team works.
  6. 6
    Test, then turn it onRun once against a sample, confirm the output, then enable the trigger.

Run this workflow in your colony.

14-day trial. No DevOps. No Sales call. Provisioned in under a minute.