I have some data preparation that needs to be done while ingesting activity data from a source via streaming API's. Specifically, I am looking to set the eventType as "online.seller.event" if the person associated with the event is an online seller, and as "online.buyer.event" if the person associated with the event is an online buyer. However, information on whether the person is an online buyer or seller is only available in the profile dataset and is not present in the event table in the source system. I was wondering if there is a way to perform this calculation on-the-fly using the data-prep functions in AEP. Perhaps by querying the profile dataset associated with the ECID and setting the eventType to "online.buyer.event" if the person is an online buyer.
I would appreciate any guidance or suggestions you may have on this matter. Thank you for your time.
Solved! Go to Solution.
Not entirely sure if this helps but since ETL is mentioned here, I thought I'd point to the following document: