File and folder name when ingesting files and exporting to cloud storage locations

Question

Hi Community,

i have some doubt regarding file name specification both when ingesting data from a cloud storage and exporting full dataset.

1. When configuring a cloud storage connection we provide a file or folder name: when we specify file name it means that the storage should deposit always a file with the same name right? if we specify a folder name a new file (with different names) can be deposited when needed and we have no problem right?

2. when we export a dataset to a cloud storage we provide in the connection a folder name. when export is finished we find new files in that folder? or now folder containing each one a new file? standing at the documentation it should be like this. not a new file in the parent folder but a new folder containing a file

thanks!

DavidRoss91 · Accepted Answer

Hi @nick_2024

1. The way we have done this, would be to enable the connection to look at a specific sub folder. For example, an s3 connection may look like this:

/abcd-data-exchange-prod-abcd-files-exchange/A/FromTenant/Example_Folder/File_Name/

but the connection would look specific to the "Example_Folder" location. That way new files can continue to flow in.

2. From my understanding of this, a new folder is generated each time with an export date, along with the new file now within that dated folder.

Hope this helps,

David

Sign up

Login with SSO

Login to the community

Login with SSO

Scanning file for viruses.

This file cannot be downloaded