ENGINEERING

Quarantine a Test On-Demand via PR Comment Command

Lets a reviewer comment a /quarantine command on a pull request to instantly skip the named flaky test, resolve its owner, and open a tracked Linear issue without leaving the PR.

CategoryEngineering
Enginesim
Difficultyintermediate
Triggerevent
Steps6
Setup~15 min

How it runs

The automated pipeline, trigger to output.

  • TriggerGitHub issue_comment webhook on PRGitHubGitHub
  • LogicMatch /quarantine command and verify commenter access
  • ActionCommit skip annotation to PR branchGitHubGitHub
  • ActionResolve owner from CODEOWNERSGitHubGitHub
  • ActionCreate assigned Linear issue with deadlineLinearLinear
  • OutputReply on PR with confirmation and issue linkGitHubGitHub

What it does

Gives engineers a one-line PR command to quarantine a flaky test mid-review. Instead of blocking the merge or manually filing follow-ups, a reviewer types the command and the workflow handles the skip, the owner lookup, and the tracking ticket.

When to use it

Use this during code review when a known-flaky test is failing a PR that is otherwise good. It unblocks the merge in seconds while still creating an owned, deadlined re-enable task.

How it works

  1. 1A GitHub issue_comment webhook fires on every new PR comment.
  2. 2A logic step checks the comment body for the '/quarantine <test-name>' command and confirms the commenter has write access.
  3. 3The workflow commits a skip annotation for the named test onto the PR branch.
  4. 4It resolves the owner from CODEOWNERS for that test's file.
  5. 5A Linear issue is created, assigned to the owner, labeled 'flaky-quarantine', linked to the PR, with a 14-day re-enable deadline.
  6. 6The workflow replies on the PR with a confirmation reaction and the new issue link.

Set it up

What you configure once, before turning it on.

  1. 1
    Connect GitHubRepos, issues, pull requests, actions.
  2. 2
    Connect LinearIssues, projects, cycles, triage.
  3. 3
    Set each agent's modelWe leave models unset so you pick the tier — fast + cheap, or top-quality.
  4. 4
    Tune it to your dataEdit the prompts, filters, and field mappings so it matches how your team works.
  5. 5
    Test, then turn it onRun once against a sample, confirm the output, then enable the trigger.

Run this workflow in your colony.

14-day trial. No DevOps. No Sales call. Provisioned in under a minute.