File and folder name when ingesting files and exporting to cloud storage locations

[Nick_2024]

Hi Community, 

i have some doubt regarding file name specification both when ingesting data from a cloud storage and exporting full dataset. 

1. When configuring a cloud storage connection we provide a file or folder name: when we specify file name it means that the storage should deposit always a file with the same name right? if we specify a folder name a new file (with different names) can be deposited when needed and we have no problem right? 

2. when we export a dataset to a cloud storage we provide in the connection a folder name. when export is finished we find new files in that folder? or now folder containing each one a new file? standing at the documentation it should be like this. not a new file in the parent folder but a new folder containing a file 

thanks!

[DavidRoss91 · Accepted solution]

Hi @Nick_2024 

1. The way we have done this, would be to enable the connection to look at a specific sub folder. For example, an s3 connection may look like this: 

/abcd-data-exchange-prod-abcd-files-exchange/A/FromTenant/Example_Folder/File_Name/

but the connection would look specific to the "Example_Folder" location. That way new files can continue to flow in.

2. From my understanding of this, a new folder is generated each time with an export date, along with the new file now within that dated folder.

Hope this helps,

David

[Nick_2024]

clear, tnks!