MARKET RESEARCH

VoC sentiment trend pipeline to a warehouse dashboard

Weekly, it scrapes G2 and Reddit for you and your competitors, scores each snippet on sentiment and theme with OpenAI.

CategoryMarket Research
Enginesim
Difficultyadvanced
Triggerschedule
Steps6
Setup~25 min

How it runs

The automated pipeline, trigger to output.

  • TriggerWeekly schedule
  • ActionScrape G2 + Reddit for brand and rivalsApify
  • ActionScore sentiment + tag theme per snippetOpenAI
  • LogicNormalize into flat dashboard schema
  • ActionAppend weekly-partitioned rows to BigQueryGoogle BigQueryBigQuery
  • OutputSlack the refreshed dashboard + top swingSlack

What it does

It builds the data layer behind positioning decisions. Each week it collects voice-of-customer snippets across G2 and Reddit for your brand and rivals, scores them for sentiment and tags them by theme, and appends structured rows to a BigQuery table. Over time this becomes a queryable trend of how perception shifts by competitor and topic.

When to use it

Use it when you want a durable, charted record of sentiment and theme movement to power a recurring dashboard, instead of one-off memos that aren't comparable quarter to quarter.

How it works

  1. 1A weekly schedule trigger starts the collection.
  2. 2Apify scrapes G2 reviews and Reddit threads for your brand and competitor set.
  3. 3OpenAI scores each snippet for sentiment (-1 to 1) and assigns a theme tag and source.
  4. 4A logic step normalizes the records into a flat, dashboard-ready schema.
  5. 5The rows are appended to a BigQuery table partitioned by week.
  6. 6A Slack note links the refreshed dashboard and flags the biggest week-over-week swing.

Set it up

What you configure once, before turning it on.

  1. 1
    Connect ApifyActors, scrapers, datasets.
  2. 2
    Connect OpenAIModels, embeddings, files.
  3. 3
    Connect BigQueryDatasets, queries, schemas.
  4. 4
    Connect SlackChannels, DMs, threads, mentions.
  5. 5
    Set each agent's modelWe leave models unset so you pick the tier — fast + cheap, or top-quality.
  6. 6
    Tune it to your dataEdit the prompts, filters, and field mappings so it matches how your team works.
  7. 7
    Test, then turn it onRun once against a sample, confirm the output, then enable the trigger.

Run this workflow in your colony.

14-day trial. No DevOps. No Sales call. Provisioned in under a minute.