Discovery Integrations with AB Testing Tools
Bloomreach seamlessly integrates with third-party AB testing tools, allowing you to evaluate optimizations that can encompass both Discovery-specific elements and elements managed by your AB testing solution.
Third-party AB testing vs. Discovery AB testing
The following will help you understand the differences between third-party and Discovery AB Testing use cases:
Third-party AB testing | Discovery AB testing |
---|---|
There can be test cases where you curate Bloomreach experiences in conjunction with a broader AB Test you are creating. Suppose you are trying out a new holiday-themed promotion and comparing it to the default experience. You may change the banners and offers generated by Bloomreach as part of the test while also changing some of the editorial content and site navigation that are powered by your AB Testing solution. Bloomreach allows you to test such comprehensive changes in liaison with your AB Testing tool while ensuring that the search and category results, recommendations, or content are unique for each experience. Some other example test cases are:
| If you’re interested in a more detailed analysis by diving into the Bloomreach results only, you can proceed by launching an AB Test within Bloomreach. Note: Bloomreach currently supports AB testing for ranking changes and site search redirects. |
Third-party Testing based on URL Parameter
Suppose you want to AB test two or more experiences in your AB Testing platform. As part of this test, you may want to check how a combination of content and product changes works. It is possible to do so with Bloomreach.
Each variation or experience that you create in your tool will need a separate value for the URL parameter, and those values will align with Bloomreach audiences. Here are the details for setting up:
-
Set up Audiences
Bloomreach Audiences can be configured based on URL parameters (as shown below). -
Show targeted results
After configuring the Audience, you can trigger a unique experience for each Bloomreach Audience. This is known as Targeting. To show different results for each experience, select the desired audience from the Audience dropdown provided in the Product Grid Editor. -
AB Test setup
Now, configure the AB test in your testing tool and create each experience/variation. Assign each variation a different URL parameter value that corresponds to the previously created audiences.For example:
testvar=variationA
testvar=varationB
This will ensure that when each test runs, the experience seen is consistent with the audiences that you created.Note: The test may also include other features outside of Bloomreach's control, such as UI changes.
-
Evaluation
Use your AB Testing tool to track which experience was more effective.
Updated 9 months ago