AI & RAG
Is This Metric Normal? On-Call Baseline Answer Bot
An on-call engineer asks 'is this metric normal?' in Slack, and the bot answers with the live value compared against historical Datadog baselines.
How it runs
The automated pipeline, trigger to output.
- TriggerOn-call engineer mentions the bot in Slack with a metric questionSlack
- ActionParse question into a Datadog metric query and time window (OpenAI)OpenAI
- ActionFetch current value and time-of-day historical baselines from DatadogDatadog
- ActionRetrieve the runbook section defining the healthy range from ConfluenceConfluence
- LogicClassify the reading as normal, elevated, or anomalous vs baseline
- OutputReply in Slack thread with verdict, baseline comparison, and runbook citationSlack
What it does
When an on-call engineer posts a question like "is checkout p99 latency normal right now?" in a Slack channel, this bot pulls the current metric value from Datadog, compares it against the same metric's historical baseline (last 7 and 28 days, same time-of-day window), and answers in plain English with a verdict: normal, elevated, or anomalous. Every answer cites the Confluence runbook passage that defines the expected range so the engineer can trust and trace the call.
When to use it
Use it during incidents or routine on-call shifts when someone sees a number on a dashboard and isn't sure whether it warrants action. It replaces the "let me scroll through three weeks of graphs" reflex with a cited, two-second answer.
How it works
- 1A Slack mention or slash command triggers the flow with the engineer's question.
- 2An OpenAI step parses the question into a Datadog metric query and time window.
- 3Datadog returns the current value plus historical series for matching time-of-day windows.
- 4Confluence is searched for the runbook section defining that metric's healthy range.
- 5OpenAI synthesizes a verdict from the live value, the computed baseline, and the runbook text.
- 6The bot replies in-thread with the verdict, the baseline comparison, and a runbook citation link.
Set it up
What you configure once, before turning it on.
- 1Connect SlackChannels, DMs, threads, mentions.
- 2Connect DatadogMetrics, traces, log search.
- 3Connect ConfluenceSpaces, pages, blueprints.
- 4Connect OpenAIModels, embeddings, files.
- 5Set each agent's modelWe leave models unset so you pick the tier — fast + cheap, or top-quality.
- 6Tune it to your dataEdit the prompts, filters, and field mappings so it matches how your team works.
- 7Test, then turn it onRun once against a sample, confirm the output, then enable the trigger.
More AI & RAG workflows
Publish a Grounded API FAQ Page to Confluence Weekly
Each week, clusters the top unanswered or repeated API questions, generates spec-grounded answers with citations.
Detect Breaking API Changes from Spec Diffs and Alert Owners
Compares the new OpenAPI spec against the previous version on each GitLab merge, uses retrieval over the changelog to classify whether changes are breaking.
Pre-meeting prep brief grounded in Coda and CRM
Before each booked sales meeting, builds a one-page prep brief by combining the account's HubSpot context with grounded talking points and objection responses pulled from your…
Coda-grounded sales answer bot with citations in Slack
Reps ask product, pricing, or competitive questions in Slack and get an answer drawn only from your Coda knowledge hub, with links to the exact docs and rows it pulled from.
Weekly knowledge-gap digest from unanswered rep questions
Each week, scans rep questions the answer bot couldn't ground in Coda, clusters the recurring gaps.
RFP and security questionnaire drafter grounded in Coda
Drafts answers to inbound RFP and security questionnaire questions by retrieving approved language from your Coda hub, then files the cited draft for review before a rep sends it.
Run it inside a business
This workflow drops into a full company template. Import the org, and this is one of the playbooks its agents run.

Run this workflow in your colony.
14-day trial. No DevOps. No Sales call. Provisioned in under a minute.
