Load data feed into Azure data lake and analyze

Avatar

Avatar

martinh36864894

Avatar

martinh36864894

martinh36864894

23-10-2018

we are trying to load Adobe Data Feed into Azure Storage Blob and do some initial data analysis. I tried with AWS, altough it's quite slow, S3 + Athena works for this, but I'd like to know if there is any alternative way to do the same analysis in Microsoft Azure before building a data warehouse. Azure is required...

1. Does anyone have any suggestion? for data analysis on Azure storage Blob, or if other Azure service is preferred

2. Next step, we will build a data warehouse with ETL. We also like to know the best practice.

Some information: I'm using daily delivery raw Adobe Data Feed data to Azure Storage Blob. Everyday, a new zip or tar.gz (contains a .tsv) file is added. For 30 days, I will have 30 files.

W

Thanks,
Martin

Replies

Avatar

Avatar

Gigazelle

Employee

Avatar

Gigazelle

Employee

Gigazelle
Employee

29-10-2018

Clarification - do you have the Adobe Analytics side working? Is your question geared towards analysis on Azure?

Avatar

Avatar

martinh36864894

Avatar

martinh36864894

martinh36864894

29-10-2018

Thanks for reply. Yes. from Adobe side, data feed works and I can see raw data file coming to S3, Blob, or SFTP.

I was wondering if you or anyone in the community has relevant experience in setting up analytic platform of data feed data in Microsoft Azure cloud.

Martin

T

Avatar

Avatar

Gigazelle

Employee

Avatar

Gigazelle

Employee

Gigazelle
Employee

29-10-2018

Gotcha. Unfortunately I don't have much experience with Azure, but hopefully someone in the community can chime in!

Avatar

Avatar

martinh36864894

Avatar

martinh36864894

martinh36864894

29-10-2018

Great! Thanks.

Avatar

Avatar

pithia

Avatar

pithia

pithia

15-06-2019

Do you have any feedvack on this. Did you manage to connect it to Azure?

Avatar

Avatar

stanleyb7066674

Avatar

stanleyb7066674

stanleyb7066674

18-07-2019

Martin,

Did you found a solution to connect Analytics data feed into Azure BLOB?

Thanks in Advance!

Avatar

Avatar

Franklin2

Avatar

Franklin2

Franklin2

22-01-2020

Has there been and documentation or is there a solution for ingesting Adobe Analytics data into Azure blob storage? 

Avatar

Avatar

Franklin2

Avatar

Franklin2

Franklin2

22-01-2020

Has a solution been found? I'm not finding any documentation on how to integrate Adobe Analytics data into Azure Blob Storage. 

Avatar

Avatar

hughw3

Avatar

hughw3

hughw3

27-01-2020

Adobe Analytics data feeds can be delivered to Azure Blob Storage. Documentation form Adobe is provided here: https://docs.adobe.com/content/help/en/analytics/export/analytics-data-feed/create-feed.html