AI & RAG

Postmortem Coverage Gap Detector

When a new postmortem is published, checks the existing corpus for whether a runbook already covers that failure mode and files a Linear task to write one if coverage is missing.

CategoryAI & RAG
Enginepaperclip
Difficultyadvanced
Triggerevent
Steps5
Setup~25 min

How it runs

The automated pipeline, trigger to output.

  • TriggerPostmortem published in ConfluenceConfluenceConfluence
  • ActionRetrieve existing runbook coverage from PostgresPostgreSQLPostgres
  • ActionJudge coverage and draft runbook outlineOpenAI
  • LogicBranch on covered vs gap
  • OutputFile runbook task in Linear for gapsLinearLinear

What it does

Every time a postmortem is published, this workflow asks a sharper question than 'what happened' — it asks 'do we have a runbook for this failure mode yet?' It retrieves against your existing runbook corpus, judges coverage, and when there's a gap it opens a Linear task to author the missing runbook.

When to use it

Use it to turn incidents into durable operational knowledge instead of one-off writeups. Ideal for teams that repeatedly relearn the same fixes because the postmortem never became a runbook.

How it works

  1. 1A new or updated postmortem in Confluence triggers the workflow.
  2. 2The postmortem's failure mode is embedded and matched against existing runbook chunks in Postgres.
  3. 3OpenAI judges whether current runbooks adequately cover this scenario and drafts a proposed runbook outline if not.
  4. 4A logic gate routes covered cases to a silent log and gap cases onward.
  5. 5For gaps, a Linear task is created with the outline, severity, and source postmortem link, assigned to the owning service team.

Set it up

What you configure once, before turning it on.

  1. 1
    Connect ConfluenceSpaces, pages, blueprints.
  2. 2
    Connect PostgresAny Postgres URL — query, write, migrate.
  3. 3
    Connect OpenAIModels, embeddings, files.
  4. 4
    Connect LinearIssues, projects, cycles, triage.
  5. 5
    Set each agent's modelWe leave models unset so you pick the tier — fast + cheap, or top-quality.
  6. 6
    Tune it to your dataEdit the prompts, filters, and field mappings so it matches how your team works.
  7. 7
    Test, then turn it onRun once against a sample, confirm the output, then enable the trigger.

Run this workflow in your colony.

14-day trial. No DevOps. No Sales call. Provisioned in under a minute.