Loomi BigQuery

Loomi BigQuery (formerly Engagement BigQuery, or EBQ) is a petabyte-scale data storage solution that exports data from your Marketing project to Google BigQuery. It provides secure, scalable storage with read-only access for custom analytics using your BI tools.

What is Loomi BigQuery?

Loomi BigQuery stores data from your Marketing project in Google BigQuery. Events and customer properties keep the same structure they have in your Marketing project, which lets you run custom analytics and create reports using your preferred BI tools.

Key features

• Data updates: Events load every 6 hours (four times a day). Customer attributes and IDs load daily.
• Access: Read-only through BigQuery Console, client libraries, or GCP service accounts.
• Retention: 10-year rolling window (9 years past, 1 year future).
• Data types: Events and customer properties.

Important considerations

• Loomi BigQuery exports Bloomreach data to BigQuery. BigQuery integration imports data from BigQuery into Bloomreach.
• Loomi BigQuery isn't a backup solution. Re-importing deleted data requires your initiative and cost. If you need help, contact your CSM to arrange support from a technical consultant.

Data retention rules

• Events older than 9 years are deleted from Loomi BigQuery.
• Events dated more than 1 year in the future are discarded.
• Customer profile deletions in Bloomreach also delete from Loomi BigQuery (customer IDs and attributes).
• Event deletions in Bloomreach don't delete from Loomi BigQuery automatically. Learn how to handle deleted events.

Benefits

• Loomi BigQuery is a petabyte-scale storage solution, so you can keep exporting and querying your Marketing data as it grows.
• Event and customer tables keep the same structure as in your Marketing project. You can run custom analytics and create reports in your preferred BI tools.
• Access is read-only and limited to members of a Google Group your CSM manages. Bloomreach reviews accounts inactive for more than 180 days to protect against security threats, including unauthorized access.
• Data is kept in a 10-year rolling window (9 years past, 1 year future). It's retained even after you delete events in the app, so Loomi BigQuery works as long-term storage for analysis.
• Your CSM adds team members directly to your Google Group. Team members use Google user accounts to work in BigQuery Console and BI tools, and service accounts for API access.
• Your contract usually includes a prepaid allowance, and you can check your usage in the Bloomreach usage dashboard. The volume of data your queries scan is the primary driver of query cost, so filtering on the partitioned timestamp column helps you stay within your allowance.
• Connect BI tools like Tableau, Power BI, Qlik, and Google Data Studio, or use JDBC/ODBC drivers and the BigQuery API. You can also schedule queries that store results in your own BigQuery project.

Work with Loomi BigQuery

• Access Loomi BigQuery: Set up Google accounts, connect tools, and manage user permissions.
• Data schema: Understand event tables, customer tables, and property types.
• Reconcile data with the app: Account for deleted events, duplicate campaign events, and customer merges.
• Anonymize customer data: Handle GDPR and CCPA data removal requests.
• Export and automate data: Monitor data loads and schedule exports to your own BigQuery project.
• Optimize usage and costs: Reduce the data your queries process.