ENGINEERING

Vercel preview QA gate that sets a GitHub commit status

Runs a multi-route smoke suite against a fresh Vercel preview and writes a pass/fail commit status check back to the GitHub PR so merge can be blocked until the preview is…

CategoryEngineering
Enginesim
Difficultyintermediate
Triggerwebhook
Steps5
Setup~15 min

How it runs

The automated pipeline, trigger to output.

  • TriggerVercel preview deployment readyVercelVercel
  • ActionProbe critical routes over HTTPHTTP webhook
  • LogicAggregate route results into pass/fail
  • ActionSet GitHub commit status checkGitHubGitHub
  • OutputComment broken routes on PR if failedGitHubGitHub

What it does

When a Vercel preview deploy goes live, this workflow probes several critical routes, then posts a GitHub commit status check (success or failure) on the head commit of the associated pull request. That status becomes a required check, so the PR can't merge until the preview passes.

When to use it

Use it when you want preview verification to be a hard merge gate, not just an FYI. Ideal for teams enforcing branch protection who want automated preview health as a required status.

How it works

  1. 1A Vercel deployment-ready webhook supplies the preview URL and Git commit SHA.
  2. 2The flow runs HTTP requests against a configured list of critical routes (home, login, API health).
  3. 3A logic step aggregates the results — all routes must return 2xx to pass.
  4. 4The workflow calls the GitHub Statuses API to set a `preview/qa-gate` check on the commit, success or failure, with a target link to the preview.
  5. 5On failure it also adds a PR comment listing exactly which routes broke.

Set it up

What you configure once, before turning it on.

  1. 1
    Connect VercelDeploys, runtime logs, analytics.
  2. 2
    Connect HTTP webhookTrigger any URL on agent actions.
  3. 3
    Connect GitHubRepos, issues, pull requests, actions.
  4. 4
    Set each agent's modelWe leave models unset so you pick the tier — fast + cheap, or top-quality.
  5. 5
    Tune it to your dataEdit the prompts, filters, and field mappings so it matches how your team works.
  6. 6
    Test, then turn it onRun once against a sample, confirm the output, then enable the trigger.

Run this workflow in your colony.

14-day trial. No DevOps. No Sales call. Provisioned in under a minute.