Your achievements

Level 1

0% to

Level 2

Tip /
Sign in

Sign in to Community

to gain points, level up, and earn exciting badges like the new
Bedrock Mission!

Learn more

View all

Sign in to view all badges

Configurable output foldering for data feed

Avatar

Level 1

27-03-2017

Hi there,

 

I was hoping the data feed could have a feature to create folders based on the year, month and day of the data processed.

 

This could help with managing the database/S3 bucket

 

e.g. 

data/2017/03/27/01-data_20170327-100000.tsv.gz

data/2017/03/28/01-data_20170328-100000.tsv.gz

data/2017/03/29/01-data_20170329-100000.tsv.gz

 

 

Cheers.

1 Comment