Add and manage records

After creating your catalog, add new records through imports. This guide covers how to add records to your general catalog using imports or manual entry. To add records to your product catalog, use Item collections.

Add records with imports

1. Create a new import

1. Go to Data & Assets > Catalogs.
2. Find the catalog and click View.
3. Click the + Record, then choose Set up a new import.
4. Name the import.

2. Select the import type

• Full feed: Replaces all existing records with the imported data.
• Delta feed (Replace items/rows): Replaces existing records based on matching IDs or adds new records.
• Delta feed (Partial): Updates specific columns without overwriting existing data. If no matching column exists, it adds new records.

3. Choose a data source

Choose the source to import your data:

• URL: Download using an HTTPS URL.
• Data warehouses: Import from BigQuery, Snowflake, and Databricks.
• File storage locations:
  • SFTP: Import data via SFTP.
  • Amazon S3: Connect to Amazon S3 to import data files.
  • Google Cloud Storage: Connect to Google Cloud Storage (GCS) to import data files.

4. Map data and schedule import

1. Click Next.

2. In the Data mapping step, validate that the data source is correct by previewing its columns. Optionally, use the timezone selector to modify the timezone of DateTime values.

   

3. Assigning an item ID is mandatory. Drag the item_id field bubble to the column that contains your item ID. This also becomes the record identifier.

4. Click Next.

5. Choose an import type: single or repeated. Save and run the import.

5. Monitor and manage imports

After setting up the import, monitor its status in the Imports tab. Use this tab to manage and view import definitions for your catalog, including their names and statuses. You can choose to edit an import, delete an existing import definition, or re-run an import.

After the import completes, an items update job starts, transforming the records into items. Depending on the size of the imported data, the import job and items update job may take some time to complete. Once complete, the Feed tab of the catalog displays the records.

Add individual records

To manually add individual records:

1. In the Feed tab, click the + Record button.
2. Choose Manually add record.
3. Enter a unique Record ID (also the item ID).
4. Add fields to the record by using existing attributes or creating new ones, and assign each a data type and a value.
5. Click + Record.

View and manage records

In the Feed tab, view all of your records. Search for specific records using their identifier. Click a record to view its fields, types, and values. You can perform the following actions:

• Click Edit record to edit records directly in the feed view.

• Duplicate a record with the Clone record option, ensuring the new one has a unique identifier.

  

• Click Delete record to remove a record.

• Toggle ON Show changed records to display only modified records.

  

Click the Save changes to apply updates.