ENGINEERING

Turn a Slack Flaky-Test Report into a Quarantine PR

When an engineer reports a flaky test from a Slack shortcut, it verifies the test exists, opens a GitHub PR that quarantines it, and files a Linear deflake ticket linking both.

CategoryEngineering
Enginesim
Difficultybeginner
Triggerevent
Steps6
Setup~5 min

How it runs

The automated pipeline, trigger to output.

  • TriggerSlack flaky-test report shortcutSlack
  • ActionConfirm test path and owner via GitHub search/blameGitHubGitHub
  • LogicBranch if test not found, request clarification
  • ActionOpen quarantine PR skipping the testGitHubGitHub
  • ActionFile Linear deflake ticket linking report and PRLinearLinear
  • OutputReply with PR and ticket links in Slack threadSlack

What it does

It gives engineers a one-tap path from "this test is flaky again" to a real, tracked fix. From a Slack message shortcut they name the test; the workflow confirms the test exists in the repo, opens a GitHub PR adding it to the quarantine skip list, and creates a Linear deflake ticket that links the report, the PR, and the assignee.

When to use it

Use it when flake reports currently die in Slack threads. This captures the human signal at the moment of frustration and converts it into auditable engineering work without anyone leaving chat.

How it works

  1. 1A Slack message shortcut triggers the workflow with the reported test identifier.
  2. 2A GitHub action searches the repo to confirm the test path and current owner via blame.
  3. 3A logic step branches: if the test isn't found, reply asking for clarification and stop.
  4. 4A GitHub action opens a quarantine PR skipping the test and tagging the owner.
  5. 5A Linear action files a deflake ticket linking the Slack report and the PR.
  6. 6A Slack reply confirms the PR and ticket back in the thread.

Set it up

What you configure once, before turning it on.

  1. 1
    Connect SlackChannels, DMs, threads, mentions.
  2. 2
    Connect GitHubRepos, issues, pull requests, actions.
  3. 3
    Connect LinearIssues, projects, cycles, triage.
  4. 4
    Set each agent's modelWe leave models unset so you pick the tier — fast + cheap, or top-quality.
  5. 5
    Tune it to your dataEdit the prompts, filters, and field mappings so it matches how your team works.
  6. 6
    Test, then turn it onRun once against a sample, confirm the output, then enable the trigger.

Run this workflow in your colony.

14-day trial. No DevOps. No Sales call. Provisioned in under a minute.