CHATBOTS

Discord FAQ Free-Text Answer Grader

When a member submits a free-text answer in their onboarding thread, an agent grades it against the canonical FAQ knowledge base, replies with targeted feedback.

CategoryChatbots
Enginepaperclip
Difficultyadvanced
Triggerevent
Steps6
Setup~25 min

How it runs

The automated pipeline, trigger to output.

  • TriggerMember posts free-text answer in onboarding threadDiscordDiscord
  • ActionRetrieve canonical FAQ entry for current stepNotionNotion
  • ActionGrade answer against reference, generate feedbackOpenAI
  • LogicBranch on grade: pass vs retry
  • ActionAdvance member or post coaching feedback in DiscordDiscordDiscord
  • OutputLog graded attempt to SupabaseSupabaseSupabase

What it does

This agent handles open-ended onboarding questions where a single reaction is not enough. When a member posts a free-text reply, the agent retrieves the authoritative answer from your FAQ knowledge base, grades the member's response for correctness and completeness, and either advances them or returns specific feedback on what to fix.

When to use it

Use it for communities that ask comprehension questions ("summarize our refund policy in your own words") rather than yes/no confirmations. It enforces real understanding while giving members coaching instead of a blunt rejection.

How it works

  1. 1A Discord message in an onboarding thread triggers the flow.
  2. 2The agent retrieves the canonical FAQ entry for the current step from Notion.
  3. 3OpenAI grades the member's free-text answer against that reference and produces a pass/fail plus feedback.
  4. 4A logic branch routes on the grade.
  5. 5On pass, the agent advances the member to the next step in Discord; on fail, it posts the targeted feedback and asks them to retry.
  6. 6The graded attempt is logged to Supabase.

Set it up

What you configure once, before turning it on.

  1. 1
    Connect DiscordCommunity channels + voice + bots.
  2. 2
    Connect NotionPages, databases, comments.
  3. 3
    Connect OpenAIModels, embeddings, files.
  4. 4
    Connect SupabaseTables, auth, storage, edge functions.
  5. 5
    Set each agent's modelWe leave models unset so you pick the tier — fast + cheap, or top-quality.
  6. 6
    Tune it to your dataEdit the prompts, filters, and field mappings so it matches how your team works.
  7. 7
    Test, then turn it onRun once against a sample, confirm the output, then enable the trigger.

Run this workflow in your colony.

14-day trial. No DevOps. No Sales call. Provisioned in under a minute.