CONTENT CREATION

Back-Translate Changed UI Strings in a PR and Block on Meaning Drift

On every pull request that touches localization files, back-translates each changed translated string to the source language and posts a PR check that fails when the round-trip…

CategoryContent Creation
Enginesim
Difficultyintermediate
Triggerevent
Steps5
Setup~15 min

How it runs

The automated pipeline, trigger to output.

  • TriggerPull request opened or updated touching locale filesGitHubGitHub
  • ActionFetch PR diff and extract changed target stringsGitHubGitHub
  • ActionBack-translate each target string to source languageOpenAI
  • LogicScore equivalence; flag drift and placeholder mismatches
  • OutputPost PR check status and inline review commentGitHubGitHub

What it does

Watches pull requests for changes to your translation catalogs (JSON, PO, or XLIFF), back-translates each modified target string into the source language with an LLM, compares it to the original source string, and reports drift directly on the PR as a status check.

When to use it

When translators or AI translation tools touch strings frequently and you want a gate that catches meaning changes (negations dropped, tone flipped, placeholders mangled) before the locale ships. Ideal for teams shipping multilingual UI on a fast release cadence.

How it works

  1. 1A pull request opens or updates, triggering on changes under your `locales/` path.
  2. 2The flow pulls the diff from GitHub and extracts each added or modified target string with its source key.
  3. 3For each string, the LLM back-translates the target back into the source language.
  4. 4A comparison step scores semantic equivalence and flags entries below the threshold or with placeholder mismatches.
  5. 5The result is posted as a GitHub commit status (check) plus an inline review comment listing the drifted strings, blocking merge until resolved.

Set it up

What you configure once, before turning it on.

  1. 1
    Connect GitHubRepos, issues, pull requests, actions.
  2. 2
    Connect OpenAIModels, embeddings, files.
  3. 3
    Set each agent's modelWe leave models unset so you pick the tier — fast + cheap, or top-quality.
  4. 4
    Tune it to your dataEdit the prompts, filters, and field mappings so it matches how your team works.
  5. 5
    Test, then turn it onRun once against a sample, confirm the output, then enable the trigger.

Run this workflow in your colony.

14-day trial. No DevOps. No Sales call. Provisioned in under a minute.