SUMMARIZATION

Per-Deploy Sentry Regression Digest to Slack

On each Vercel deploy, finds the error issues newly introduced by that release and posts a plain-English digest of the new clusters to Slack so the team knows what broke before…

CategorySummarization
Enginesim
Difficultyintermediate
Triggerwebhook
Steps5
Setup~15 min

How it runs

The automated pipeline, trigger to output.

  • TriggerVercel deployment-succeeded webhook with release versionVercelVercel
  • ActionQuery Sentry for issues first-seen in this releaseSentrySentry
  • LogicFilter out known issues and low-event noise
  • ActionSummarize and rank the new error clustersOpenAI
  • OutputPost the deploy regression digest to SlackSlack

What it does

Every time a release ships, this workflow asks Sentry which error issues first appeared in that release and turns the raw issue list into a readable digest: what the new error clusters are, how often they are firing, and which parts of the app they touch. The summary lands in Slack within minutes of the deploy, so the team sees regressions tied directly to the change that caused them.

When to use it

Use it when you deploy often and your Sentry inbox is too noisy to scan after every release. Ideal for teams who want a deploy-scoped "what's new and broken" readout instead of trawling the full issue stream.

How it works

A Vercel deployment-succeeded webhook fires with the release version. The flow queries Sentry for issues whose first-seen release matches that deploy and filters out anything already known or below an event-count floor. The surviving clusters are passed to the model, which groups them by symptom, ranks by frequency and impact, and writes a tight summary with links back to each Sentry issue. The digest posts to a Slack channel; if no new regressions are found, it posts a short all-clear instead.

Set it up

What you configure once, before turning it on.

  1. 1
    Connect VercelDeploys, runtime logs, analytics.
  2. 2
    Connect SentryErrors, performance, releases.
  3. 3
    Connect OpenAIModels, embeddings, files.
  4. 4
    Connect SlackChannels, DMs, threads, mentions.
  5. 5
    Set each agent's modelWe leave models unset so you pick the tier — fast + cheap, or top-quality.
  6. 6
    Tune it to your dataEdit the prompts, filters, and field mappings so it matches how your team works.
  7. 7
    Test, then turn it onRun once against a sample, confirm the output, then enable the trigger.

Run this workflow in your colony.

14-day trial. No DevOps. No Sales call. Provisioned in under a minute.