A/B testing in Clarity

A/B testing helps you measure Clarity's impact by comparing 2 groups: a control group (who doesn’t see Clarity) and a test group (who interacts with Clarity). This article explains how Clarity A/B testing works and how to interpret the results to refine your strategy.

A/B test ratio

Clarity includes built-in A/B testing. By default:

  • 90% of users see Clarity.

  • 10% don’t see Clarity (the control group shortened as CG).

    A/B test ratio for global and use case split

    A/B testing global 90:10 split and use case weblayers (WBL) split.

You can adjust the ratio based on your needs. However, a 90:10 provides a large enough control group for meaningful comparisons while maximizing exposure for most customers.

Choose a test ratio

  • 50/50 split: The most accurate evaluation of how much value Clarity is adding.
  • 90/10 split: Best for long-term use. It maximizes exposure while maintaining a control group for comparison.

Read more about how A/B testing works.

Global and local A/B testing

Clarity uses tiered A/B testing:

  • Global: Compares a global control group (no Clarity) with a global Clarity variant (using Clarity). This gives a clear uplift comparison between having and not having Clarity.
Clarity global A/B test metrics in the Evaluation initiative.

Go to the Clarity Evaluation initiative to view Global A/B testing metrics.

  • Local: Evaluate individual use cases to see how Clarity performs in different contexts. For example, high-traffic areas (search) may have different performance compared to lower-traffic, high-impact areas (cart pages).

The global A/B test helps evaluate Clarity's overall impact, while the local test helps assess specific use cases.