It depends on what type of data you are bringing. Set up proper TTL on the dataset to clear up old/same data. If you are ingesting FULL Load everyday then you can setup TTL as 3 days, or if it is incremental data then based on the business decision TTL can be 1 year.