ENGINEERING

Explain a flagged coverage drop when a reviewer asks

When a reviewer comments a trigger phrase on an MR, it analyzes which changed files dropped coverage and replies with a plain-English, file-level explanation and suggested tests.

CategoryEngineering
Enginesim
Difficultyintermediate
Triggerevent
Steps5
Setup~15 min

How it runs

The automated pipeline, trigger to output.

  • TriggerGitLab MR comment matches trigger phraseGitLabGitLab
  • ActionFetch coverage report and changed filesGitLabGitLab
  • ActionIsolate files and lines that lost coverageShell
  • ActionExplain drop and suggest testsOpenAI
  • OutputPost explanation as MR reply noteGitLabGitLab

What it does

This workflow answers the natural follow-up to a coverage-delta note: why did it drop. When a reviewer posts a trigger phrase (for example, `/why-coverage`) in an MR comment, it pulls the coverage diff for that MR, identifies the specific files and lines that lost coverage, and asks an LLM to explain in plain English what is now untested and which tests would close the gap. The answer is posted as a reply note on the MR.

When to use it

Use it when the raw coverage-delta number isn't actionable on its own and reviewers keep asking authors to chase down the cause by hand. This turns the question into a one-line command.

How it works

  1. 1A GitLab note (comment) webhook fires and matches the trigger phrase.
  2. 2The workflow fetches the MR's coverage report and changed files.
  3. 3A shell step isolates the files and lines whose coverage decreased.
  4. 4An OpenAI step turns that into a readable explanation plus concrete test suggestions.
  5. 5It posts the explanation as a threaded reply note on the merge request.

Set it up

What you configure once, before turning it on.

  1. 1
    Connect GitLabRepos, MRs, pipelines, registry.
  2. 2
    Connect ShellRun sandboxed commands inside the workspace.
  3. 3
    Connect OpenAIModels, embeddings, files.
  4. 4
    Set each agent's modelWe leave models unset so you pick the tier — fast + cheap, or top-quality.
  5. 5
    Tune it to your dataEdit the prompts, filters, and field mappings so it matches how your team works.
  6. 6
    Test, then turn it onRun once against a sample, confirm the output, then enable the trigger.

Run this workflow in your colony.

14-day trial. No DevOps. No Sales call. Provisioned in under a minute.