Load data feed into Azure data lake and analyze | Community
Skip to main content
martinh36864894
martinh36864894
Level 2
October 23, 2018

Load data feed into Azure data lake and analyze

  • October 23, 2018
  • 3 replies
  • 8150 views

we are trying to load Adobe Data Feed into Azure Storage Blob and do some initial data analysis. I tried with AWS, altough it's quite slow, S3 + Athena works for this, but I'd like to know if there is any alternative way to do the same analysis in Microsoft Azure before building a data warehouse. Azure is required...

1. Does anyone have any suggestion? for data analysis on Azure storage Blob, or if other Azure service is preferred

2. Next step, we will build a data warehouse with ETL. We also like to know the best practice.

Some information: I'm using daily delivery raw Adobe Data Feed data to Azure Storage Blob. Everyday, a new zip or tar.gz (contains a .tsv) file is added. For 30 days, I will have 30 files.

W

Thanks,
Martin

This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.

3 replies

Gigazelle
Adobe Employee
GigazelleAdobe Employee
Adobe Employee
October 29, 2018

Clarification - do you have the Adobe Analytics side working? Is your question geared towards analysis on Azure?

martinh36864894
martinh36864894Author
Level 2
October 29, 2018

Thanks for reply. Yes. from Adobe side, data feed works and I can see raw data file coming to S3, Blob, or SFTP.

I was wondering if you or anyone in the community has relevant experience in setting up analytic platform of data feed data in Microsoft Azure cloud.

Martin

T

Gigazelle
Adobe Employee
GigazelleAdobe Employee
Adobe Employee
October 29, 2018

Gotcha. Unfortunately I don't have much experience with Azure, but hopefully someone in the community can chime in!

N
Adobe Employee
npithiaAdobe Employee
Adobe Employee
June 15, 2019

Do you have any feedvack on this. Did you manage to connect it to Azure?

T
tony3
July 18, 2019

Martin,

Did you found a solution to connect Analytics data feed into Azure BLOB?

Thanks in Advance!

Terms & ConditionsAccessibility statement

Loading footer...