Expand my Community achievements bar.

Join us for the next Community Q&A Coffee Break on Tuesday April 23, 2024 with Eric Matisoff, Principal Evangelist, Analytics & Data Science, who will join us to discuss all the big news and announcements from Summit 2024!

Configurable output foldering for data feed

Avatar

Level 1

3/27/17

Hi there,

 

I was hoping the data feed could have a feature to create folders based on the year, month and day of the data processed.

 

This could help with managing the database/S3 bucket

 

e.g. 

data/2017/03/27/01-data_20170327-100000.tsv.gz

data/2017/03/28/01-data_20170328-100000.tsv.gz

data/2017/03/29/01-data_20170329-100000.tsv.gz

 

 

Cheers.

2 Comments