AI & RAG
Weekly Runbook Coverage Gap Report for Datadog Spikes
Weekly, it reviews the spikes that the knowledge base answered poorly, identifies which Datadog monitors lack good runbook coverage.
How it runs
The automated pipeline, trigger to output.
- TriggerWeekly schedule starts the coverage review
- ActionRead past week's alert and retrieval-confidence logsPostgres
- LogicAggregate and rank low-coverage spikes by monitor
- ActionCheck Confluence for existing pages, propose new titlesConfluence
- ActionDraft runbook outlines for the top gapsOpenAI
- OutputPost prioritized gap report to SlackSlack
What it does
Closes the loop on the knowledge base itself. It looks back at the week's alerts and the retrieval confidence each one produced, finds the monitors that repeatedly returned weak or no runbook matches, and turns that into a ranked list of documentation gaps with suggested page titles.
When to use it
Use it when on-call keeps hitting alerts the runbooks do not cover and you want a data-driven backlog of what to write. It makes 'we should document that' a concrete weekly task instead of a vague intention.
How it works
- 1A weekly schedule starts the review.
- 2The flow reads the past week's alert and retrieval-confidence logs from Postgres.
- 3It aggregates low-confidence and no-match spikes by monitor and metric.
- 4A logic step ranks gaps by alert frequency and absence of runbook coverage.
- 5An LLM proposes runbook titles and outlines for the top gaps, checking Confluence to avoid duplicating existing pages.
- 6The prioritized gap report is posted to the team's Slack channel.
Set it up
What you configure once, before turning it on.
- 1Connect PostgresAny Postgres URL — query, write, migrate.
- 2Connect ConfluenceSpaces, pages, blueprints.
- 3Connect OpenAIModels, embeddings, files.
- 4Connect SlackChannels, DMs, threads, mentions.
- 5Set each agent's modelWe leave models unset so you pick the tier — fast + cheap, or top-quality.
- 6Tune it to your dataEdit the prompts, filters, and field mappings so it matches how your team works.
- 7Test, then turn it onRun once against a sample, confirm the output, then enable the trigger.
More AI & RAG workflows
RFP and security questionnaire drafter grounded in Coda
Drafts answers to inbound RFP and security questionnaire questions by retrieving approved language from your Coda hub, then files the cited draft for review before a rep sends it.
Detect Breaking API Changes from Spec Diffs and Alert Owners
Compares the new OpenAPI spec against the previous version on each GitLab merge, uses retrieval over the changelog to classify whether changes are breaking.
Grounded reply suggestions for inbound sales email
Reads inbound prospect emails, retrieves the matching answers from your Coda hub.
Coda-grounded sales answer bot with citations in Slack
Reps ask product, pricing, or competitive questions in Slack and get an answer drawn only from your Coda knowledge hub, with links to the exact docs and rows it pulled from.
On-Call Spec Answerer from Dropbox Engineering Corpus
Answers on-call questions posted in a Slack channel by retrieving the most relevant Dropbox engineering specs and replying with a grounded, source-cited answer in the thread.
Agentic Deep-Dive API Researcher for Hard Spec Questions
An agent fielded via webhook that answers multi-part API questions by iteratively searching OpenAPI specs, changelogs, and Confluence runbooks.
Run it inside a business
This workflow drops into a full company template. Import the org, and this is one of the playbooks its agents run.

Run this workflow in your colony.
14-day trial. No DevOps. No Sales call. Provisioned in under a minute.
