Discovery Integrations with AB Testing Tools

Bloomreach seamlessly integrates with third-party AB testing tools, allowing you to evaluate optimizations that can encompass both Discovery-specific elements and elements managed by your AB testing solution.

Third-party AB testing vs. Discovery AB testing


The following will help you understand the differences between third-party and Discovery AB Testing use cases:

Third-party AB testingDiscovery AB testing
There can be test cases where you curate Bloomreach experiences in conjunction with a broader AB Test you are creating.

Suppose you are trying out a new holiday-themed promotion and comparing it to the default experience. You may change the banners and offers generated by Bloomreach as part of the test while also changing some of the editorial content and site navigation that are powered by your AB Testing solution.

Bloomreach allows you to test such comprehensive changes in liaison with your AB Testing tool while ensuring that the search and category results, recommendations, or content are unique for each experience.

Some other example test cases are:
  • Test a keyword widget versus a category widget.
  • Test direct API boosting parameters such as boosting by store on API calls.
  • Test your algorithm strategies using API-based algorithm controls.
  • Test different banner content associated with the keyword or category results.
  • Test experience when your site is caching the Discovery response and changes on the Discovery end aren’t visible on the site.
If you’re interested in a more detailed analysis by diving into the Bloomreach results only, you can proceed by launching an AB Test within Bloomreach.

Note: Bloomreach currently supports AB testing for ranking changes and site search redirects.

Third-party Testing based on URL Parameter


Suppose you want to AB test two or more experiences in your AB Testing platform. As part of this test, you may want to check how a combination of content and product changes works. It is possible to do so with Bloomreach.

Each variation or experience that you create in your tool will need a separate value for the URL parameter, and those values will align with Bloomreach audiences. Here are the details for setting up:

  1. Set up Audiences
    Bloomreach Audiences can be configured based on URL parameters (as shown below).

  2. Show targeted results
    After configuring the Audience, you can trigger a unique experience for each Bloomreach Audience. This is known as Targeting. To show different results for each experience, select the desired audience from the Audience dropdown provided in the Product Grid Editor.

    Choose the desired Audience for the change

    Choose the desired Audience for the change

  3. AB Test setup
    Now, configure the AB test in your testing tool and create each experience/variation. Assign each variation a different URL parameter value that corresponds to the previously created audiences.

    For example:

    testvar=variationA
    testvar=varationB

    This will ensure that when each test runs, the experience seen is consistent with the audiences that you created.

    Note: The test may also include other features outside of Bloomreach's control, such as UI changes.

  4. Evaluation
    Use your AB Testing tool to track which experience was more effective.