Expand my Community achievements bar.

Join us for the next Community Q&A Coffee Break on Tuesday April 23, 2024 with Eric Matisoff, Principal Evangelist, Analytics & Data Science, who will join us to discuss all the big news and announcements from Summit 2024!

Testing Standard Data Feeds - Allow Request for 1 Hour (not just 1 Day)

Avatar

Level 1

10/30/14

In order to test Standard Data Feeds, allow the choice of not simply a date range, down to a single day's worth of data, but allow request for a range of hours, down to a single hour. For some of our suites, to test the delivery mechanics, file layout and basic ETL processing, even a day's worth of data can be several GB (even an hour's worth of uncompressed data). While I can ask for a day's worth of data, partitioned into multiple 2GB-pre-compressed chunks, currently, that's still much bigger than necessary for some of the simplest testing.