ENGINEERING

Escalate dependency bumps that fix a CVE but carry breaking changes

For each dependency-bump PR, cross-checks the changelog for both security-fix and breaking-change signals; when a bump is security-critical yet high-risk, it pages on-call…

CategoryEngineering
Enginesim
Difficultyadvanced
Triggerevent
Steps6
Setup~25 min

How it runs

The automated pipeline, trigger to output.

  • TriggerDependency-bump PR openedGitHubGitHub
  • ActionFetch changelog + release notes for rangeGitHubGitHub
  • ActionLLM scores security urgency + breaking riskOpenAI
  • LogicIsolate security-critical AND high-risk bumps
  • ActionApply security + risk:high labelsGitHubGitHub
  • OutputPage on-call with tradeoff summaryPagerDutyPagerDuty

What it does

Some bumps are urgent because they patch a CVE, yet risky because they also change behavior. This workflow grades both dimensions from the changelog and release notes, then escalates the conflict case — security-critical AND high breaking-change risk — to PagerDuty so on-call can weigh ship-now-and-fix versus hold-and-test instead of letting it sit in a queue.

When to use it

Use it when security patches can't simply auto-merge because the same release also ships breaking changes, and you need a human to make the call quickly rather than discovering the conflict days later.

How it works

  1. 1A PR-opened webhook fires on dependency-bump PRs.
  2. 2The flow fetches the changelog and release notes for the version range.
  3. 3An LLM extracts two scores: security urgency and breaking-change risk.
  4. 4A logic branch isolates PRs that are both security-critical and high-risk.
  5. 5Matching PRs get `security` and `risk:high` labels on GitHub.
  6. 6A PagerDuty incident is created for on-call with the tradeoff summary and PR link.

Set it up

What you configure once, before turning it on.

  1. 1
    Connect GitHubRepos, issues, pull requests, actions.
  2. 2
    Connect OpenAIModels, embeddings, files.
  3. 3
    Connect PagerDutyIncidents, on-call, escalations.
  4. 4
    Set each agent's modelWe leave models unset so you pick the tier — fast + cheap, or top-quality.
  5. 5
    Tune it to your dataEdit the prompts, filters, and field mappings so it matches how your team works.
  6. 6
    Test, then turn it onRun once against a sample, confirm the output, then enable the trigger.

Run this workflow in your colony.

14-day trial. No DevOps. No Sales call. Provisioned in under a minute.