DEVOPS

Run Datadog synthetics against the preview and gate on results

Triggers a Datadog synthetic test batch against the new Vercel preview URL, waits for outcomes, and blocks merge via a GitHub status when any synthetic check fails.

CategoryDevOps
Enginesim
Difficultyadvanced
Triggerwebhook
Steps5
Setup~25 min

How it runs

The automated pipeline, trigger to output.

  • TriggerVercel preview deployment readyVercelVercel
  • ActionTrigger Datadog synthetic batch on preview URLDatadogDatadog
  • ActionAwait batch and fetch resultsDatadogDatadog
  • LogicRequire all synthetics green
  • OutputSet GitHub merge gate statusGitHubGitHub

What it does

Uses your existing Datadog synthetic tests as the smoke gate for ephemeral previews. When a Vercel preview is ready, it kicks off a tagged Datadog synthetic batch pointed at the preview URL, polls until the batch finishes, and turns the aggregate outcome into a GitHub commit status. Real browser and API checks decide whether the PR can merge.

When to use it

Use it when you've already invested in Datadog synthetics for production and want to reuse those exact journeys on previews — getting browser-level coverage instead of hand-rolled HTTP pings, with results visible in the same Datadog dashboards.

How it works

  1. 1Vercel signals that the preview deployment is ready.
  2. 2A Datadog action triggers the synthetic test batch with the preview URL injected as a variable.
  3. 3The workflow waits for the batch to complete and pulls per-test results.
  4. 4A logic branch passes only if every synthetic check is green.
  5. 5A GitHub commit status is written to gate the merge, carrying a link to the Datadog batch run.

Set it up

What you configure once, before turning it on.

  1. 1
    Connect VercelDeploys, runtime logs, analytics.
  2. 2
    Connect DatadogMetrics, traces, log search.
  3. 3
    Connect GitHubRepos, issues, pull requests, actions.
  4. 4
    Set each agent's modelWe leave models unset so you pick the tier — fast + cheap, or top-quality.
  5. 5
    Tune it to your dataEdit the prompts, filters, and field mappings so it matches how your team works.
  6. 6
    Test, then turn it onRun once against a sample, confirm the output, then enable the trigger.

Run this workflow in your colony.

14-day trial. No DevOps. No Sales call. Provisioned in under a minute.