DEVOPS

Re-verify Quarantined Tests and Auto-Unquarantine Stable Ones

On a schedule, triggers isolated reruns of every quarantined test, and for any test that passes consistently across all attempts.

CategoryDevOps
Enginesim
Difficultyadvanced
Triggerschedule
Steps6
Setup~25 min

How it runs

The automated pipeline, trigger to output.

  • TriggerDaily schedule
  • ActionDispatch isolated reruns of quarantined testsGitHubGitHub
  • LogicPassed every attempt = stable?
  • ActionOpen PR removing skip annotationGitHubGitHub
  • ActionClose matching Linear ticketLinearLinear
  • OutputReturn list of reinstated tests

What it does

This workflow closes the loop on quarantine. Quarantined tests tend to stay skipped forever; this re-runs each one in isolation many times and, when a test proves stable again, automatically proposes returning it to the blocking suite and closes its tracking ticket.

When to use it

Use this when quarantine has become a graveyard. It keeps the skip list honest by continuously re-testing flagged tests and reinstating the ones that have quietly become reliable — often after an unrelated infra or dependency fix.

How it works

  1. 1A scheduled trigger fires (e.g. daily).
  2. 2The flow reads the current quarantine list and dispatches an isolated GitHub Actions run that executes each quarantined test N times.
  3. 3A logic step evaluates results: a test passing every attempt is deemed stable.
  4. 4For each stable test it opens a GitHub PR removing the skip annotation.
  5. 5It transitions the matching Linear ticket to Done with a comment linking the verification run.
  6. 6A list of reinstated tests is returned as the output.

Set it up

What you configure once, before turning it on.

  1. 1
    Connect GitHubRepos, issues, pull requests, actions.
  2. 2
    Connect LinearIssues, projects, cycles, triage.
  3. 3
    Set each agent's modelWe leave models unset so you pick the tier — fast + cheap, or top-quality.
  4. 4
    Tune it to your dataEdit the prompts, filters, and field mappings so it matches how your team works.
  5. 5
    Test, then turn it onRun once against a sample, confirm the output, then enable the trigger.

Run this workflow in your colony.

14-day trial. No DevOps. No Sales call. Provisioned in under a minute.