ENGINEERING

Nightly latency-budget sweep: batch slow traces into one GitLab epic

Runs every night to query Honeycomb for all traces that breached their latency budget that day, correlates each with Sentry errors.

CategoryEngineering
Enginesim
Difficultyadvanced
Triggerschedule
Steps5
Setup~25 min

How it runs

The automated pipeline, trigger to output.

  • TriggerNightly scheduled sweep
  • ActionQuery Honeycomb for all over-budget traces (24h)Honeycomb
  • ActionFetch Sentry error counts per service windowSentrySentry
  • LogicRank by duration overage + error volume, keep top N
  • OutputWrite ranked daily GitLab digest issueGitLabGitLab

What it does

Replaces a flood of per-trace alerts with one daily digest. A scheduled sweep pulls the day's budget-breaching Honeycomb traces, correlates each with Sentry errors, ranks them by impact, and writes a single GitLab issue listing the top offenders with links and suggested owners — ready for standup.

When to use it

Use when real-time paging is overkill but you still want latency regressions tracked. Great for teams that review reliability once a day and want a prioritized, deduplicated list rather than scattered notifications.

How it works

  1. 1A scheduled trigger runs nightly after traffic settles.
  2. 2The workflow queries Honeycomb for all traces over budget in the past 24 hours.
  3. 3For each distinct service it fetches the day's Sentry error counts in the matching windows.
  4. 4It ranks traces by a blend of duration overage and correlated error volume, keeping the top N.
  5. 5A single GitLab issue is created (or updated for the day) with the ranked table and per-row trace and error links.

Set it up

What you configure once, before turning it on.

  1. 1
    Connect HoneycombDistributed traces and queries.
  2. 2
    Connect SentryErrors, performance, releases.
  3. 3
    Connect GitLabRepos, MRs, pipelines, registry.
  4. 4
    Set each agent's modelWe leave models unset so you pick the tier — fast + cheap, or top-quality.
  5. 5
    Tune it to your dataEdit the prompts, filters, and field mappings so it matches how your team works.
  6. 6
    Test, then turn it onRun once against a sample, confirm the output, then enable the trigger.

Run this workflow in your colony.

14-day trial. No DevOps. No Sales call. Provisioned in under a minute.