ENGINEERING

Quarantined-test expiry watchdog: nag owners before skips rot

Runs weekly, finds tests still carrying a quarantine skip annotation past their SLA, escalates the linked Linear ticket.

CategoryEngineering
Enginesim
Difficultyintermediate
Triggerschedule
Steps5
Setup~15 min

How it runs

The automated pipeline, trigger to output.

  • TriggerWeekly schedule
  • ActionScan repo for active quarantine annotationsGitHubGitHub
  • LogicFilter to skips past SLA
  • ActionEscalate the linked Linear ticketLinearLinear
  • OutputPing assigned owner in SlackSlack

What it does

Prevents quarantine from becoming permanent. It scans the repo for tests still tagged as quarantined, checks how long each has been skipped against an SLA, and escalates the stale ones so coverage gaps don't quietly accumulate.

When to use it

Use alongside any quarantine workflow. Skipping a flaky test buys time but creates a coverage hole; this watchdog makes sure each skip has an expiry and an owner who gets nagged until the test is fixed and re-enabled.

How it works

  1. 1A weekly schedule triggers the run.
  2. 2The flow scans the GitHub repo for current quarantine annotations and their applied dates.
  3. 3A branch filters to tests skipped longer than the SLA (e.g. 14 days).
  4. 4For each stale skip, it bumps the linked Linear ticket priority and adds an escalation comment.
  5. 5It pings the assigned owner in Slack with the test name, days quarantined, and the ticket link.

Set it up

What you configure once, before turning it on.

  1. 1
    Connect GitHubRepos, issues, pull requests, actions.
  2. 2
    Connect LinearIssues, projects, cycles, triage.
  3. 3
    Connect SlackChannels, DMs, threads, mentions.
  4. 4
    Set each agent's modelWe leave models unset so you pick the tier — fast + cheap, or top-quality.
  5. 5
    Tune it to your dataEdit the prompts, filters, and field mappings so it matches how your team works.
  6. 6
    Test, then turn it onRun once against a sample, confirm the output, then enable the trigger.

Run this workflow in your colony.

14-day trial. No DevOps. No Sales call. Provisioned in under a minute.