How to manage changes on inbound data flow linked to existing schema that are currently in production with live data ingestion | Community
Skip to main content
Luca_Lattarini
Luca_Lattarini
Level 9
September 18, 2022
Solved

How to manage changes on inbound data flow linked to existing schema that are currently in production with live data ingestion

  • September 18, 2022
  • 2 replies
  • 815 views

Hello guys,

 

I have an existing schema in production with hourly ingestion data. Soon the inbound data will not provide an attribute which is currently mandatory. What is the best option to manage this?  Can I delete the field or make it optional?

Thanks

This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.
Best answer by Vikashyadav

Hi @luca_lattarini,

Since this is existing schema which might be associated with datasets having some data in it, making a field as optional could be a better option. Deleting a field from schema could make existing dataset incompatible.   

2 replies

V
VikashyadavAccepted solution
Level 3
September 18, 2022

Hi @luca_lattarini,

Since this is existing schema which might be associated with datasets having some data in it, making a field as optional could be a better option. Deleting a field from schema could make existing dataset incompatible.   

    ChetanyaJain-1
    Community Advisor
    ChetanyaJain-1Community Advisor
    Community Advisor
    September 18, 2022

    @luca_lattarini 

    If the schema is profile enabled then the best option is to make it non-mandatory as @vikashyadav suggested. Here are some rules to understand the breaking changes https://experienceleague.adobe.com/docs/experience-platform/xdm/schema/composition.html?lang=en#evolution

     

    To perform the cleanup, you will need to delete the entire set of records by deleting the dataset batches and then cleaning up the schema. Reconstruct the schema, re-create the API endpoint (if any) or reconfigure the batch ingestion/data mapping, etc and then ingest the data.

     

    Thanks,

    Chetanya

      Terms & ConditionsAccessibility statement

      Loading footer...