DEVOPS

Run preview QA checklist when a PR is labeled ready-for-qa

When a reviewer adds the ready-for-qa label, finds the PR's Vercel preview, runs an interactive QA checklist in the browser.

CategoryDevOps
Enginesim
Difficultyintermediate
Triggerevent
Steps6
Setup~15 min

How it runs

The automated pipeline, trigger to output.

  • TriggerGitHub PR labeled eventGitHubGitHub
  • LogicPass only the ready-for-qa label
  • ActionResolve latest Vercel preview for the PR branchVercelVercel
  • ActionRun checklist items in headless browserBrowserbase
  • LogicCompile pass/fail/skipped counts
  • OutputPost checklist report and swap labels on PRGitHubGitHub

What it does

This workflow puts QA on demand. Adding the `ready-for-qa` label to a pull request triggers a full checklist run against that PR's live Vercel preview: each item is a scripted browser interaction, and the results come back as a tidy markdown report in the PR conversation.

When to use it

Use it when not every commit needs QA but reviewers want a one-click way to validate a candidate before merge, with a documented checklist trail attached to the PR.

How it works

  1. 1GitHub fires a `pull_request labeled` event; a logic step passes only the `ready-for-qa` label.
  2. 2The workflow queries the Vercel API for the latest ready preview deployment on that PR's branch.
  3. 3Browserbase executes each checklist item against the preview, capturing per-step screenshots.
  4. 4A logic step compiles items into pass, fail, and skipped counts.
  5. 5A formatted checklist report with screenshots is posted as a PR comment.
  6. 6If any item failed, the `ready-for-qa` label is removed and `qa-failed` is applied.

Set it up

What you configure once, before turning it on.

  1. 1
    Connect GitHubRepos, issues, pull requests, actions.
  2. 2
    Connect VercelDeploys, runtime logs, analytics.
  3. 3
    Connect BrowserbaseHeadless browsers, sessions, replays.
  4. 4
    Set each agent's modelWe leave models unset so you pick the tier — fast + cheap, or top-quality.
  5. 5
    Tune it to your dataEdit the prompts, filters, and field mappings so it matches how your team works.
  6. 6
    Test, then turn it onRun once against a sample, confirm the output, then enable the trigger.

Run this workflow in your colony.

14-day trial. No DevOps. No Sales call. Provisioned in under a minute.