A/B tests tools

list_discovery_experiments

Lists the A/B test experiments in an account. The response gives you paginated summaries with each experiment's name, status, traffic allocation, buckets (variants), and scheduling details. Filter by status or name to narrow the list.

Use get_discovery_experiment for the full configuration of one experiment, and get_discovery_experiment_report for its statistical results.

Request parameters

NameTypeRequired?Description
account_namestr | nullNoThe account name. If you have exactly one account, it's selected for you.
site_group_idstr | int | nullNoA site group ID or site name. Defaults to the account level (-1).
pageintNoThe page number, zero-based. Defaults to 0.
limitintNoThe number of results per page. Defaults to 10.
sort_bystrNoThe field to sort by: MODIFIED_AT, STARTED_AT, EXPERIMENT_NAME, or ID. Defaults to MODIFIED_AT.
sort_orderstrNoThe sort direction, ASC or DESC. Defaults to DESC.
qstr | nullNoA search term, at least 3 characters, to filter by experiment or user name.
experiment_statusesstr | nullNoA comma-separated list of statuses to filter by: DRAFT, RUNNING, COMPLETED, or ARCHIVED.

Response parameters

The tool returns an ExperimentsResponse object with the following parameters:

ParameterTypeDescription
successboolWhether the request succeeded.
datalist[ExperimentSummary]The experiments in the account.
errorstr | nullError message if the request failed.

The ExperimentSummary object has the following fields:

FieldTypeDescription
idintThe experiment's unique ID.
experimentNamestr | nullThe experiment's display name.
experimentTypestr | nullThe experiment type, targeting or testing.
experimentStatusstr | nullThe status: DRAFT, RUNNING, COMPLETED, or ARCHIVED.
isEditablebool | nullWhether the experiment can be edited.
sitegroupIdint | nullThe site group this experiment runs on.
influencestr | nullThe influence metric.
trafficPercentageint | nullThe total percentage of traffic allocated to the experiment.
startedAtint | nullUnix timestamp in milliseconds of when the experiment started.
endedAtint | nullUnix timestamp in milliseconds of when the experiment ended.
modifiedAtint | nullUnix timestamp in milliseconds of the last modification.
userstr | nullThe user who last modified the experiment.
isInternalbool | nullWhether this is an internal experiment.
notestr | nullAn optional note.
bucketslist[ExperimentBucket]The traffic buckets (variants) in the experiment.

The ExperimentBucket object has the following fields:

FieldTypeDescription
idint | nullThe bucket's ID.
bucketNamestr | nullThe bucket's display name.
trafficPercentageint | nullThe percentage of traffic routed to this bucket.
bucketDescriptionstr | nullThe bucket's description.
controlbool | nullWhether this is the control bucket.
ruleIdentifierInfoExperimentBucketRuleInfo | nullThe rule info for the variant.

The ExperimentBucketRuleInfo object has the following fields:

FieldTypeDescription
idint | nullThe rule ID.
ruleTypestr | nullThe rule type, such as ranking or redirect.
variantIdint | nullThe variant ID.
modifiedAtint | nullUnix timestamp in milliseconds of the last modification.
userstr | nullThe user who last modified the rule.
querylist[ExperimentBucketQuery]The queries associated with this rule.

The ExperimentBucketQuery object has the following fields:

FieldTypeDescription
idint | nullThe query identifier.
querystr | nullThe query text.
queryTypestr | nullThe query type, such as sitesearch or category.

get_discovery_experiment

Returns the full configuration of a single experiment, including its traffic allocation, buckets with rule info, success metric, and winner bucket if the experiment has completed. Use list_discovery_experiments first to find the experiment ID you want.

Request parameters

NameTypeRequired?Description
experiment_idintYesThe experiment ID returned by list_discovery_experiments.
account_namestr | nullNoThe account name. If you have exactly one account, it's selected for you.
site_group_idstr | int | nullNoA site group ID or site name. Defaults to the account level (-1).

Response parameters

The tool returns an ExperimentResponse object with the following parameters:

ParameterTypeDescription
successboolWhether the request succeeded.
dataExperimentDetail | nullThe full experiment record.
errorstr | nullError message if the request failed.

The ExperimentDetail object adds the following fields on top of the summary record:

FieldTypeDescription
successMetricstr | nullThe success metric: AOV - Average Order Value, ATC Rate - Add to Cart Rate, CR - Conversion Rate, or RPV - Revenue Per Visit.
winnerBucketIdint | nullThe ID of the winning bucket, set when the experiment completes.

get_discovery_experiment_report

Returns the analytics report for an experiment. The report shows performance metrics such as visitors, conversions, revenue, and statistical confidence, comparing the test buckets against a control bucket over a date range.

Every parameter is required. Use list_discovery_experiments or get_discovery_experiment first to obtain the bucket names and dates.

Request parameters

NameTypeRequired?Description
experiment_idintYesThe experiment ID.
start_datestrYesThe start date in YYYYMMDD format, for example 20240101.
end_datestrYesThe end date in YYYYMMDD format, for example 20240131.
test_bucketsstrYesA comma-separated list of test bucket names.
control_bucketstrYesThe control bucket name.
experiment_session_typestrYesThe session type: SEARCH, CATEGORY, or GLOBAL.
experiment_namestrYesThe experiment name. Must match exactly.

Response parameters

The tool returns an ExperimentReportResponse object with the following parameters:

ParameterTypeDescription
successboolWhether the request succeeded.
dataany | nullThe report data, returned as freeform JSON from the analytics backend.
errorstr | nullError message if the request failed.

© Bloomreach, Inc. All rights reserved.