A/B testing in Clarity

A/B testing helps you measure Clarity's impact by comparing 2 groups: a control group (who doesn’t see Clarity) and a test group (who interacts with Clarity). This article explains how Clarity A/B testing works and how to interpret the results to refine your strategy.

A/B test ratio

Clarity includes built-in A/B testing. By default:

• 90% of users see Clarity.

• 10% don’t see Clarity (the control group shortened as CG).

  

You can adjust the ratio based on your needs. However, a 90:10 provides a large enough control group for meaningful comparisons while maximizing exposure for most customers.

Choose a test ratio

• 50/50 split: The most accurate evaluation of how much value Clarity is adding.
• 90/10 split: Best for long-term use. It maximizes exposure while maintaining a control group for comparison.

Read more about how A/B testing works.

Global and local A/B testing

Clarity uses tiered A/B testing:

• Global: Compares a global control group (no Clarity) with a global Clarity variant (using Clarity). This gives a clear uplift comparison between having and not having Clarity.

• Local: Evaluate individual use cases to see how Clarity performs in different contexts. For example, high-traffic areas (search) may have different performance compared to lower-traffic, high-impact areas (cart pages).

The global A/B test helps evaluate Clarity's overall impact, while the local test helps assess specific use cases.