agent hive

SUMMARIZATION

Post-deploy span regression check with GitHub annotation

When a deploy webhook arrives, waits for a bake window, compares span latencies before and after the release, and if a regression is detected.

CategorySummarization
Enginesim
Difficultyadvanced
Triggerwebhook
Steps6
Setup~25 min

How it runs

The automated pipeline, trigger to output.

  • TriggerDeploy webhook with release SHA arrivesHTTP webhook
  • ActionQuery Honeycomb before/after span latenciesHoneycomb
  • LogicBranch: stop if no service regressed past threshold
  • ActionDraft regression narrative tied to the commitOpenAI
  • ActionComment narrative on the GitHub commitGitHubGitHub
  • OutputAlert perf channel with verdictSlack

What it does

This workflow ties latency regressions to the deploy that caused them. On a deploy webhook, it waits out a bake window, then compares Honeycomb span latencies in the pre-deploy and post-deploy windows for the affected services. If a meaningful regression appears, it writes a narrative linking the slowdown to that release and comments it directly on the GitHub commit, plus pings Slack.

When to use it

Use it when you want every deploy automatically vetted for latency impact, with the finding attached to the exact commit so the author sees it without digging. It closes the loop between "we shipped" and "things got slow."

How it works

  1. 1A deploy webhook fires with the release SHA and timestamp.
  2. 2The workflow waits the configured bake window for traffic to stabilize.
  3. 3It queries Honeycomb for span latencies in the before and after windows.
  4. 4It branches: if no service regressed past threshold, the run records a clean result and stops.
  5. 5An LLM drafts a regression narrative naming the slowed operations and the suspect commit.
  6. 6The narrative is posted as a comment on the GitHub commit and to the perf Slack channel.

Set it up

What you configure once, before turning it on.

  1. 1
    Connect HoneycombDistributed traces and queries.
  2. 2
    Connect OpenAIModels, embeddings, files.
  3. 3
    Connect GitHubRepos, issues, pull requests, actions.
  4. 4
    Connect SlackChannels, DMs, threads, mentions.
  5. 5
    Connect HTTP webhookTrigger any URL on agent actions.
  6. 6
    Set each agent's modelWe leave models unset so you pick the tier — fast + cheap, or top-quality.
  7. 7
    Tune it to your dataEdit the prompts, filters, and field mappings so it matches how your team works.
  8. 8
    Test, then turn it onRun once against a sample, confirm the output, then enable the trigger.

Run this workflow in your colony.

14-day trial. No DevOps. No Sales call. Provisioned in under a minute.