HomeEngagementContentDiscoveryOther resources
Release notes
Back to All

🚀 Release 2025-52

July 31st, 2025

Release dates: July 30, 2025 & July 31, 2025

TL;DR: A/B testing report enhancements, Catalog-specific algorithm in Ranking studio. Fixed bugs to enhance the dashboard experience.

Subscribe to Discovery release updates

📈 Improvements

A/B test reports improvements and outlier exclusion

What improved?

  • Introduced an option to exclude outliers in A/B test reports.

  • The system automatically identifies outliers based on anomalous behavior. It excludes them from the test result computations and alters the table and chart data accordingly.

  • Added new trend charts for Lift (daily and cumulative) and Confidence.

  • View and interact with multiple charts for different metrics at once using the improved chart selector.

  • Toggle different trend lines in charts by clicking on the labels under the x-axis.

  • Improvements in the downloaded file for reports and a new Copy data button.

Why are these valuable?

  • Outlier exclusion ensures more reliable test results by excluding undesirable sources of traffic.
  • Smoother experience of working with charts, providing more detailed insights.
  • Downloaded test result file now contains separate columns for individual Lift and Confidence values, making them easier to read and use.

Known issue

  • In the Lift and Confidence charts for RPV and AOV, values are shown in units of price. These are percentage values.

Catalog-specific algorithm training in Ranking studio

What improved?

  • Train a custom ML ranking algorithm on your catalog and site traffic pattern.

  • Signal weights are learned and set using the selected catalog instead of global catalog data.

Why is this valuable?

Train a custom ranking algorithm on your specific product and performance data. Adding a custom signal is no longer a requirement for training a catalog-specific algorithm.

Check the full documentation.

Empty state pages in Product grid insights

The Rules and Performance tabs now show an empty state with suggestions on next steps and applications of the tool.

  • The page is displayed when no query or category is selected in the Rules tab.
  • In the Performance tab, it also shows up when enough data isn't available to show performance.

🐛 Bug fixes

  • Edits to existing Dynamic categories after reaching the maximum limit of 150 categories failed to save. This issue has been fixed.
  • Issues with Visual editor changes syncing with the API response have been resolved.