Data Warehouse FTP

[skatofiabah]

Hi,

We just ran a Data Warehouse Request and FTP. It says it's CSV but how do we access it?

[MandyGeorge]

That will depend on the destination that you set up. When you created the data warehouse job, one of the pages asked for an account and location. 

Under report destination it asks for an account and location. The account is the type of destination that you're going to send it to. It sounds like you're using an FTP. It should ask you for the account properties. Then you need to set up the location, this will be the exact spot where it will send the file. 

Just a note, FTP for data warehouse is considered legacy, although you can still use it. What is it that you're planning to do with the file? If it's a one time drop, you could have it sent to your email (or anyone's email). 

[skatofiabah]

Hi @MandyGeorge,

How do you open an FTP with a location path and port? Also, can you send a Data Warehouse Request to your email to open a CSV file via email?

[NicoleYa]

Not sure if this helps, but we used Azure Synapse pipeline to copy data from the FTP server with path and port, and stored data into Azure data lake. But then this become unavailable since 11/05/2024 because the data warehouse is deprecated. so now we are trying to look for new options. 

[Jennifer_Dungan]

What do you mean the Data Warehouse is deprecated? It's not deprecated... this is part of the tools available to you, there is no sign of it being removed... 

[NicoleYa]

 i was told the data warehouse is deprecated due to security reasons. our production jobs started failing since 11/05 due to the unavailability of data warehouse. i am not sure whether we are referring to the same data warehouse though but that's what happened to our team.

[Jennifer_Dungan]

I'm really not sure what to say to that... Data Warehouse is very much alive in Adobe... and even the API you mentioned below is just a way to access the Data Warehouse without using the UI... 

Maybe you are talking about the switch over from the old UI to the new UI? Adobe recently pushed out a new Data Warehouse interface... I think it's was rolled out slowly to customers... maybe you were just migrated?

[Jennifer_Dungan]

You can access FTP through any client side FTP tool, I like Filezilla (you only need the "client", not the "server" version), and you can log into FTP using the same credentials that you used in your Data Warehouse Export.

As others have said, FTP is legacy, but I still use it for quick and easy one time pulls... if you are creating a repeating process you might want to set up like a server to receive the files (but this you would have to work with your team to choose what fits best into your organization).

As to your question about emailing the CSV to yourself... the answer is yes, but with caveats....  Data Warehouse exports can be large, and emails will reject files if they are too large...  So you might be able to email the files to yourself, if they are small enough... but if not, the export will fail with a "file too large" error.

[skatofiabah]

Hi @Jennifer_Dungan,

If FTP is legacy, what is used now? I don't know if our organization will allow FileZilla.

[Jennifer_Dungan]

Filezilla is one of a million FTP clients out there... You don't have to use that one, but if you are uploading files to FTP you will need some FTP client to download your files....

Technically you can open an FTP through command prompt on windows (https://learn.microsoft.com/en-us/windows-server/administration/windows-commands/ftp) but it's kind of a pain...

Having a client is much easier (and you can save your connection settings to easily get back into the server for future files)

These are the Data Warehouse Account Options:

Even if FTP is "legacy" it doesn't mean you can't use it... like I said, I use it... but we really are only using Data Warehouse right now for one-time exports when we are doing some investigations...  If I were using Data Warehouse for a long term schedule, I would work with my DevOps team to set up a more standardized location... and that would completely depend on what servers we have access to... so I can't answer the question of "what you should use".... that is something you have to work out with your team.

[NicoleYa]

Hi, 

Related to data warehouse, wondering is the data warehouse API route is also considered as legacy? we are trying to examine whether this can be a long term solution for us: https://developer.adobe.com/analytics-apis/docs/2.0/guides/endpoints/data-warehouse/#get-report-by-i...

[Jennifer_Dungan]

The API is part of the 2.0 designation, so I wouldn't think that using the API is legacy at all...  the legacy part is really just pertaining to where you are sending your data... FTP is less secure than some of the other methods... but if you aren't sending PII, the risk is pretty low... it's not really any more insecure than email.... 

You should be fine to proceed with investigating the API route, @NicoleYa 

[NicoleYa]

Thanks @Jennifer_Dungan. One quick question here, i have read from the doc that the delivery part in the data warehouse API body call refers to the destination, and I saw the Azure blob is an option for the destination. Do you happen to have an example of how to configure Azure storage account/data lakes as the delivery? (the very bottom part of this page: Configure a report destination for a Data Warehouse request | Adobe Analytics)