Kafka

Kafka is a distributed event streaming platform for high-throughput, real-time data processing. This guide explains how the integration works and what's involved in setting it up.

Bloomreach uses elastic.io as middleware to bridge Kafka's atomic, unstructured data with Bloomreach's structured event-based data model. Raw data from Kafka is transformed into the right format, then sent to Bloomreach where it becomes available for campaigns and analytics. Your Client Services team handles the implementation with you—your team manages the Kafka setup on your side, and Bloomreach works with you on the rest.

📘
Note
This integration is designed for recurring data sync. For a major initial load of data, use imports instead.

How the integration works

The integration has 3 parts.

Load data from Kafka

The flow starts with the Kafka component in elastic.io, which receives atomic data input for processing. See the component documentation for details and limitations.

Transform raw data into structured data

Bloomreach only accepts data structured to match its data model. A Code component in elastic.io handles the transformation—selecting the data you want to send and restructuring it accordingly.

Bloomreach Client Services works with you on this step.

Send data to Bloomreach

After transformation, a REST API component in elastic.io sends the data to the Bloomreach Marketing API. This activates your data in Bloomreach and makes it available for campaigns and analytics.

Limitations

For component-specific limitations, see:

For more information, contact your CSM.