DEVOPS

AI-triage failed Vercel Lighthouse audits into actionable GitLab issues

When a Vercel preview fails its Lighthouse QA gate, an LLM reads the raw audit JSON, summarizes the top fixable problems with concrete remediation steps.

CategoryDevOps
Enginesim
Difficultyintermediate
Triggerwebhook
Steps6
Setup~15 min

How it runs

The automated pipeline, trigger to output.

  • TriggerVercel preview deployment readyVercelVercel
  • ActionRun Lighthouse, capture full JSONShell
  • LogicContinue only if score below threshold
  • ActionLLM ranks and explains fixesOpenAI
  • ActionOpen labeled GitLab issue with planGitLabGitLab
  • OutputComment issue link on the MRGitLabGitLab

What it does

Turns a noisy failed Lighthouse report into a prioritized, human-readable action plan. The LLM ranks opportunities by estimated impact, explains the likely cause, and suggests a fix for each, then files it as a structured GitLab issue tied back to the MR.

When to use it

Use it when raw Lighthouse output overwhelms authors and failures get ignored. Best for teams that want the gate to produce work that is immediately ready to pick up, not a wall of metrics.

How it works

  1. 1A Vercel deployment-ready webhook provides the preview URL and MR reference.
  2. 2A shell step runs Lighthouse and captures the full audit JSON.
  3. 3A logic branch proceeds only when the overall score is below the gate threshold.
  4. 4An OpenAI step summarizes the worst opportunities into ranked, fix-oriented recommendations.
  5. 5A GitLab action opens a labeled issue with the recommendations, linked to the MR.
  6. 6The MR receives a comment linking to the new triage issue.

Set it up

What you configure once, before turning it on.

  1. 1
    Connect VercelDeploys, runtime logs, analytics.
  2. 2
    Connect ShellRun sandboxed commands inside the workspace.
  3. 3
    Connect OpenAIModels, embeddings, files.
  4. 4
    Connect GitLabRepos, MRs, pipelines, registry.
  5. 5
    Set each agent's modelWe leave models unset so you pick the tier — fast + cheap, or top-quality.
  6. 6
    Tune it to your dataEdit the prompts, filters, and field mappings so it matches how your team works.
  7. 7
    Test, then turn it onRun once against a sample, confirm the output, then enable the trigger.

Run this workflow in your colony.

14-day trial. No DevOps. No Sales call. Provisioned in under a minute.