SUMMARIZATION

Block MR merge on a Sentry crash-rate regression

After a deploy, checks the new release's crash-free rate against the previous one and, if it regressed past a threshold, posts a blocking summary on the GitLab MR and pages…

CategorySummarization
Enginesim
Difficultyadvanced
Triggerevent
Steps6
Setup~25 min

How it runs

The automated pipeline, trigger to output.

  • TriggerSentry new release createdSentrySentry
  • ActionPull crash-free rate vs. previous releaseSentrySentry
  • LogicRegression exceeds threshold?
  • ActionSummarize culprit signaturesOpenAI
  • ActionPage on-callPagerDutyPagerDuty
  • OutputPost blocking or healthy note on MRGitLabGitLab

What it does

This workflow gates merges on release health. When a Sentry release lands, it compares the new crash-free session rate to the prior release. If the rate dropped beyond your threshold, it writes a summary of the offending error signatures, posts it as a blocking comment on the GitLab MR, and pages on-call. If health is fine, it posts a short green confirmation instead.

When to use it

Use it when a single bad deploy can cause real user pain and you want an automatic stop sign rather than relying on someone watching dashboards. It is the decision-logic counterpart to a plain digest.

How it works

  1. 1Sentry fires the release-created webhook.
  2. 2The flow pulls crash-free rate and top issues for the new and previous release.
  3. 3A branch checks whether the regression exceeds the configured threshold.
  4. 4On regression, an OpenAI step summarizes the likely-culprit signatures into a blocking note, posted to the GitLab MR, and PagerDuty pages on-call.
  5. 5Otherwise it posts a brief "release healthy" comment on the MR.

Set it up

What you configure once, before turning it on.

  1. 1
    Connect SentryErrors, performance, releases.
  2. 2
    Connect GitLabRepos, MRs, pipelines, registry.
  3. 3
    Connect OpenAIModels, embeddings, files.
  4. 4
    Connect PagerDutyIncidents, on-call, escalations.
  5. 5
    Set each agent's modelWe leave models unset so you pick the tier — fast + cheap, or top-quality.
  6. 6
    Tune it to your dataEdit the prompts, filters, and field mappings so it matches how your team works.
  7. 7
    Test, then turn it onRun once against a sample, confirm the output, then enable the trigger.

Run this workflow in your colony.

14-day trial. No DevOps. No Sales call. Provisioned in under a minute.