Highlighted

Load data feed into Azure data lake and analyze

martinh36864894

23-10-2018

we are trying to load Adobe Data Feed into Azure Storage Blob and do some initial data analysis. I tried with AWS, altough it's quite slow, S3 + Athena works for this, but I'd like to know if there is any alternative way to do the same analysis in Microsoft Azure before building a data warehouse. Azure is required...

1. Does anyone have any suggestion? for data analysis on Azure storage Blob, or if other Azure service is preferred

2. Next step, we will build a data warehouse with ETL. We also like to know the best practice.

Some information: I'm using daily delivery raw Adobe Data Feed data to Azure Storage Blob. Everyday, a new zip or tar.gz (contains a .tsv) file is added. For 30 days, I will have 30 files.

W

Thanks,
Martin

Replies

Highlighted

Gigazelle

Employee

29-10-2018

Clarification - do you have the Adobe Analytics side working? Is your question geared towards analysis on Azure?

Highlighted

martinh36864894

29-10-2018

Thanks for reply. Yes. from Adobe side, data feed works and I can see raw data file coming to S3, Blob, or SFTP.

I was wondering if you or anyone in the community has relevant experience in setting up analytic platform of data feed data in Microsoft Azure cloud.

Martin

T

Highlighted

Gigazelle

Employee

29-10-2018

Gotcha. Unfortunately I don't have much experience with Azure, but hopefully someone in the community can chime in!

Highlighted

Franklin2

22-01-2020

Has there been and documentation or is there a solution for ingesting Adobe Analytics data into Azure blob storage? 

Highlighted

Franklin2

22-01-2020

Has a solution been found? I'm not finding any documentation on how to integrate Adobe Analytics data into Azure Blob Storage.