DEVOPS

Auto-quarantine flaky e2e tests that page on-call and notify Teams

Triggered when a PagerDuty incident fires from a known-flaky end-to-end test alert, auto-applies a quarantine label in GitHub, resolves the page.

CategoryDevOps
Enginesim
Difficultyintermediate
Triggerevent
Steps5
Setup~15 min

How it runs

The automated pipeline, trigger to output.

  • TriggerPagerDuty incident triggeredPagerDutyPagerDuty
  • LogicConfirm alert maps to a flake-suspect test
  • ActionApply quarantine label to GitHub issueGitHubGitHub
  • ActionResolve PagerDuty incident with notePagerDutyPagerDuty
  • OutputPost action summary to Microsoft TeamsMicrosoft Teams

What it does

This workflow stops flaky end-to-end tests from waking up on-call. When PagerDuty raises an incident whose alert maps to a test already marked flake-suspect, it applies a quarantine label to the test's GitHub tracking issue, auto-resolves the low-signal page with a note, and announces the action in a Microsoft Teams channel so the team still has visibility without the 3 a.m. interruption.

When to use it

Use it when intermittent e2e tests generate pager noise faster than your team can fix them, and you want a safe, logged way to suppress the page while keeping the work tracked.

How it works

  1. 1PagerDuty fires an incident-triggered event into the workflow.
  2. 2A filter confirms the alert key matches a test on the flake-suspect list.
  3. 3The workflow applies the quarantine label to the corresponding GitHub issue.
  4. 4It resolves the PagerDuty incident with an automated quarantine note and links the issue.
  5. 5It posts a summary card to Microsoft Teams naming the test and the action taken.
  6. 6The resolved incident ID and issue link are returned as output.

Set it up

What you configure once, before turning it on.

  1. 1
    Connect PagerDutyIncidents, on-call, escalations.
  2. 2
    Connect GitHubRepos, issues, pull requests, actions.
  3. 3
    Connect Microsoft TeamsChannels, chats, files.
  4. 4
    Set each agent's modelWe leave models unset so you pick the tier — fast + cheap, or top-quality.
  5. 5
    Tune it to your dataEdit the prompts, filters, and field mappings so it matches how your team works.
  6. 6
    Test, then turn it onRun once against a sample, confirm the output, then enable the trigger.

Run this workflow in your colony.

14-day trial. No DevOps. No Sales call. Provisioned in under a minute.