EXPERT INSIGHTS

Apr-08-2020

A/B Testing in Chatbots

Khoros Staff

Editor's note: This blog post was originally written on the Flow.ai website. Flow.ai was acquired by Khoros in 2021 to advance Khoros' conversational AI and machine learning (ML) capabilities and data science expertise. This blog post has been adapted to be on the Khoros blog.



One way of optimizing digital experiences is A/B testing. A/B testing allows you to create two (or more) variants for your users. This way of testing is used a lot when optimizing websites. You create variants, select a metric and measure which of these variants has the highest conversion.

This concept is very powerful and can also be used in conversational experiences. Our A/B testing feature for your chatbot allows you to easily create variants of specific parts of your conversational experience.

Metrics and performance

Choosing the metric that matters all depends on your case. When you want to increase your Marketing & Sales with the help of an AI Chatbot then your metric can be the number of generated leads.

The example below will show you how to create A/B tests for your chatbot.

How to add A/B Testing in 3 steps

1. Create a Flow

The first step is to create a flow. Head over to the Flows section and create a new flow by clicking the plus icon. Now drag and drop the first items onto your canvas.

2. Add A/B Test

You can now add an A/B test by dragging and dropping the Trigger - Condition onto your canvas. On the right pane, you can set it to A/B test from the drop-down menu. You will now have 2 branches or variants. Complete each of the branches and your A/B test is ready.

3. Try it out

Make sure to test your A/B test. You can use the Try it out button on top or you can test it with any of the channels that you’ve integrated.

Adding more variants

Are you planning to create an A/B/C test, just drag and drop an additional Condition onto your canvas and set it to A/B test. You will now have a third variant. There is no limit to the number of conditions you can place next to each other.

This also allows you, for example, by adding ten conditions, where nine are the same and one is slightly different, to perform an A/B test where only 10% instead of 50% get the second option. This trick is also useful for Soft Launching your bot.

RELATED RESOURCES

ON-DEMAND WEBINAR

GenAI in Action #3: How a strong knowledge base fuels GenAI

Discover how to get started with your existing knowledge, what risks to consider, and why knowledge management is the future of AI.

Nov-19-2024

Read more

ONLINE COMMUNITIES

7 benefits of using AI in customer service

Discover the benefits of customer forums, from enhancing customer support to gaining actionable insights, and see how they can drive business growth.

Nov-18-2024

Read more

ONLINE COMMUNITIES

What are customer insights and how to gather them

Learn what customer insights are, why they're valuable, and how to get them to help your brand!

Nov-18-2024

Read more

Celebrating Innovation in Online Communities and Customer Engagement

In today’s fast-paced digital world, every brand aims to create loyal, satisfied customers. However, only a few rise above by embracing innovative yet customer-centric strategies on modern digital channels to deliver seamless and personalized brand experiences.

Nov-12-2024

Read more

Announcing the 2024 Khoros Kudos Winners

Each year, Khoros honors a select few top-tier brands that define industry standards for customer engagement. Read on to learn more about this year’s winners.

Nov-12-2024

Read more

GUIDE

Starting a community program content package

Take your community program from concept to reality with this all-in-one resource. Inside, you'll find all the tools you need to guide you through every stage of starting a successful community.

Nov-12-2024

Read more

ONLINE COMMUNITIES

11 great brand community examples for 2024

Explore 11 real-world examples of thriving brand communities and learn how top brands build loyalty and improve customer service through online brand communities.

Nov-12-2024

Read more

ON-DEMAND WEBINAR

Community works: How Cisco reimagined its product-focused community for customer success

Watch the on-demand webinar to discover how Cisco reimagined its product-focused community into a dynamic customer success hub.

Nov-11-2024

Read more

ON-DEMAND WEBINAR

Community Learning Labs #5: Launching your community - part 1

Explore key steps for launching a community in Session 5 of Community Learning Labs. Learn about creating a launch plan, establishing governance structures, setting guidelines, and integrating essential systems.

Nov-08-2024

Read more

ONLINE COMMUNITIES

What is a customer community and should you build one?

A customer community is an online space where customers connect with a brand and each other. Discover its benefits, examples, & how to build one.

Nov-05-2024

Read more

ON-DEMAND WEBINAR

GenAI in Action #2: Maintaining knowledge to ensure GenAI governance, control, and safety

Explore the pivotal role of knowledge management on data safety and precision and the promising, yet undefined, future of AI regulations and liability.

Nov-05-2024

Read more

ONLINE COMMUNITIES

Unlocking customer value with the power of online communities

Explore the diverse world of online communities and uncover how they unlock immense value for enterprise companies and their customers.

Oct-28-2024

Read more

    Would you like to learn more about Khoros?

    Let's talk