DEVOPS

Post Vercel preview smoke results as a PR comment

On each new Vercel preview deployment, runs a smoke suite and edits a single sticky comment on the GitHub PR with a live checklist of which routes passed or failed.

CategoryDevOps
Enginesim
Difficultybeginner
Triggerevent
Steps4
Setup~5 min

How it runs

The automated pipeline, trigger to output.

  • TriggerVercel preview deployment readyVercelVercel
  • ActionRun smoke checks on preview routesHTTP webhook
  • LogicSticky comment already exists?
  • OutputCreate or edit PR smoke commentGitHubGitHub

What it does

This workflow gives reviewers an at-a-glance QA summary right inside the pull request. When a preview deploys, it runs a smoke suite across your critical routes and renders the results as a markdown checklist. Instead of spamming the thread, it maintains one sticky comment per PR and edits it on every redeploy, so the comment always reflects the latest preview.

When to use it

Use it when your team reviews PRs in GitHub and wants smoke status visible without leaving the page. It complements a hard merge gate by giving humans the readable detail behind a pass or fail.

How it works

  1. 1Vercel fires a deployment.ready webhook for a preview build.
  2. 2The flow runs HTTP smoke checks against the preview URL and collects per-route results.
  3. 3It looks up the PR by branch and searches for an existing sticky smoke comment.
  4. 4A branch decides whether to create a new comment or edit the existing one.
  5. 5It writes the markdown checklist with the preview URL and timestamp to the PR.

Set it up

What you configure once, before turning it on.

  1. 1
    Connect VercelDeploys, runtime logs, analytics.
  2. 2
    Connect HTTP webhookTrigger any URL on agent actions.
  3. 3
    Connect GitHubRepos, issues, pull requests, actions.
  4. 4
    Set each agent's modelWe leave models unset so you pick the tier — fast + cheap, or top-quality.
  5. 5
    Tune it to your dataEdit the prompts, filters, and field mappings so it matches how your team works.
  6. 6
    Test, then turn it onRun once against a sample, confirm the output, then enable the trigger.

Run this workflow in your colony.

14-day trial. No DevOps. No Sales call. Provisioned in under a minute.