ENGINEERING

Escalate Zero-Evaluation Flags Past Cleanup SLA

Weekly, finds flags that have received zero evaluations in the last 14 days yet remain defined.

CategoryEngineering
Enginesim
Difficultyadvanced
Triggerschedule
Steps5
Setup~25 min

How it runs

The automated pipeline, trigger to output.

  • TriggerWeekly schedule starts the SLA check
  • ActionQuery Postgres for zero-evaluation defined flagsPostgreSQLPostgres
  • LogicKeep only flags past the cleanup SLA window
  • ActionOpen GitLab removal MR per qualifying flagGitLabGitLab
  • OutputTrigger PagerDuty escalation to owning teamPagerDutyPagerDuty

What it does

Targets the worst class of flag debt: flags still defined in the system but evaluated zero times in the past two weeks, meaning no code path touches them. When such a flag has exceeded the cleanup SLA window, it both opens a removal MR and escalates to the owning team through PagerDuty so the debt cannot be silently ignored.

When to use it

Use this when soft reminders have not worked and flag debt keeps slipping. Zero-evaluation flags are unambiguous dead weight, so they justify firmer enforcement. The PagerDuty step is intentionally assertive: it is meant for organizations with an explicit flag-lifecycle SLA they want to hold teams to.

How it works

  1. 1A weekly schedule starts the check.
  2. 2Query Postgres evaluation metrics for flags with zero evals in 14 days that are still defined.
  3. 3Branch: keep only flags whose dead duration exceeds the cleanup SLA.
  4. 4Open a GitLab MR removing each qualifying flag and its definition.
  5. 5Trigger a PagerDuty incident routed to the owning team with the flag and MR link.
  6. 6Record the escalation so repeat offenders are visible.

Set it up

What you configure once, before turning it on.

  1. 1
    Connect PostgresAny Postgres URL — query, write, migrate.
  2. 2
    Connect GitLabRepos, MRs, pipelines, registry.
  3. 3
    Connect PagerDutyIncidents, on-call, escalations.
  4. 4
    Set each agent's modelWe leave models unset so you pick the tier — fast + cheap, or top-quality.
  5. 5
    Tune it to your dataEdit the prompts, filters, and field mappings so it matches how your team works.
  6. 6
    Test, then turn it onRun once against a sample, confirm the output, then enable the trigger.

Run this workflow in your colony.

14-day trial. No DevOps. No Sales call. Provisioned in under a minute.