DOCUMENT OPS

Send low-confidence document classifications to a human review queue

Classifies each split document and, when the model's confidence is below a threshold, holds the file in a Dropbox review folder and notifies a reviewer instead of auto-filing it.

CategoryDocument Ops
Enginesim
Difficultyintermediate
Triggerevent
Steps5
Setup~15 min

How it runs

The automated pipeline, trigger to output.

  • TriggerNew scanned PDF in Dropbox inboxDropboxDropbox
  • ActionSplit and classify each document with a confidence scoreOpenAI
  • LogicBranch on confidence threshold
  • ActionAuto-file confident documents to type foldersDropboxDropbox
  • OutputMove uncertain docs to review folder and alert reviewerSlack

What it does

Auto-filing is great until the scanner produces a blurry or ambiguous page and the document lands in the wrong folder. This workflow adds a safety gate: documents the model is confident about file automatically, while anything uncertain is parked in a review folder and a reviewer is pinged to decide, keeping the archive clean without blocking the easy cases.

When to use it

Use it when misfiled documents are costly (legal, medical, finance) and you want automation for the clear cases but a human check on the edge cases. Good for teams adopting auto-classification gradually.

How it works

  1. 1A new scanned PDF in the Dropbox inbox triggers the run.
  2. 2The file is split into documents and each is classified with a confidence score.
  3. 3A logic branch checks each score against the confidence threshold.
  4. 4Confident documents are filed into their matching type folder automatically.
  5. 5Low-confidence documents move to a `/needs-review` folder and a Slack message alerts the reviewer with type guesses and a link.

Set it up

What you configure once, before turning it on.

  1. 1
    Connect DropboxFiles and folders.
  2. 2
    Connect OpenAIModels, embeddings, files.
  3. 3
    Connect SlackChannels, DMs, threads, mentions.
  4. 4
    Set each agent's modelWe leave models unset so you pick the tier — fast + cheap, or top-quality.
  5. 5
    Tune it to your dataEdit the prompts, filters, and field mappings so it matches how your team works.
  6. 6
    Test, then turn it onRun once against a sample, confirm the output, then enable the trigger.

Run this workflow in your colony.

14-day trial. No DevOps. No Sales call. Provisioned in under a minute.