ENGINEERING

Block merge requests that break documented examples

On every GitLab merge request, runs the README code examples against the branch's code and posts a pass/fail comment plus a commit status.

CategoryEngineering
Enginesim
Difficultyadvanced
Triggerevent
Steps6
Setup~25 min

How it runs

The automated pipeline, trigger to output.

  • TriggerGitLab merge request opened or updatedGitLabGitLab
  • ActionCheck out branch and build locallyShell
  • ActionExtract and run README code blocks against branchShell
  • LogicTally failures, compose markdown summary table
  • ActionPost results comment on the merge requestGitLabGitLab
  • OutputSet commit status to reflect example healthGitLabGitLab

What it does

This workflow makes documentation correctness part of code review. When a merge request opens or updates, it builds the branch, runs every README code example against the proposed changes, and posts the results back as an MR comment with a green or red commit status. Reviewers no longer discover a broken example after merge.

When to use it

Use it when API changes frequently invalidate README snippets and you want that caught at review time rather than nightly. Best for teams already gating merges on GitLab commit statuses who want docs treated as first-class.

How it works

  1. 1A GitLab merge request event triggers the run with the source branch.
  2. 2A shell step checks out the branch and builds it locally.
  3. 3A shell step extracts and executes each README code block against the branch build.
  4. 4A logic step tallies failures and composes a markdown summary table.
  5. 5A GitLab step posts the summary as a comment on the merge request.
  6. 6An output step sets a pending, success, or failed commit status so the merge gate reflects example health.

Set it up

What you configure once, before turning it on.

  1. 1
    Connect GitLabRepos, MRs, pipelines, registry.
  2. 2
    Connect ShellRun sandboxed commands inside the workspace.
  3. 3
    Set each agent's modelWe leave models unset so you pick the tier — fast + cheap, or top-quality.
  4. 4
    Tune it to your dataEdit the prompts, filters, and field mappings so it matches how your team works.
  5. 5
    Test, then turn it onRun once against a sample, confirm the output, then enable the trigger.

Run this workflow in your colony.

14-day trial. No DevOps. No Sales call. Provisioned in under a minute.