Expand my Community achievements bar.

Join us on September 25th for a must-attend webinar featuring Adobe Experience Maker winner Anish Raul. Discover how leading enterprises are adopting AI into their workflows securely, responsibly, and at scale.

One Schema or multiple Schemas ?

Avatar

Level 10

I am doing project for a company which consists of 3 entities. 

Data Mart would ingest to CDP 4 datasets:

- data for entity 1

- data for entity 2

- data for entity 3

- combined customer view across all entities

 

Would you make ona schema or 4 schemas? Is it some max number of fields which schema 

Topics

Topics help categorize Community content and increase your ability to discover relevant content.

2 Replies

Avatar

Level 5

If the datasets are highly similar and managed by the same team, you could use one schema.

Avatar

Level 3

I typically combine into one dataset when:

  • the data is of the same class: profile, event, or custom
  • the data will have the same primary identity
  • the data is sourced from the same system
  • the data will be sourced the same way: streaming vs batch

 

If you combine profile-class data into one dataset when all of that isn't true then you may end up forced to use "upserts" (partial record ingestion) with all of the limitations that comes with that.