A/B testing chat assistant versions on live conversations

The scenario splits users between different assistant versions and answers each with their version, to fairly compare which one performs better.

  • Comparing versions on real conversations
  • Each user is locked to one version
  • Decisions by numbers, not by gut
  • Remembers the conversation flow
SupabasePostgres Chat Memory
Set it upScriptera

How it works

To pass leads from Supabase to Postgres Chat Memory automatically, use a ready-made scenario — no manual copying, no lost leads.

  1. Starts when: When chat message received
  2. Then: Define Path Values
  3. Then: Check If Session Exists
  4. Check: If Session Does Exist
  5. If yes: Get Correct Prompt
  6. Then: AI Agent
  7. If no: Assign Path To Session
  8. Then: OpenAI Chat Model
  9. Then: Postgres Chat Memory

You can launch this Supabase + Postgres Chat Memory integration in Scriptera: describe the task in plain words — the scenario is built, launched and monitored for you.

Similar scenarios