Expand my Community achievements bar.

Join us for the next Community Q&A Coffee Break on Tuesday April 23, 2024 with Eric Matisoff, Principal Evangelist, Analytics & Data Science, who will join us to discuss all the big news and announcements from Summit 2024!

Troubleshooting Data Feeds

Avatar

Level 10

Transfer Failures

In the event of an FTP transfer failure (login denied, lost connection, out of quota, etc), Adobe attempts to automatically connect and send the data up to three separate times. If the failures persist, the feed is marked as failed and an email notification is sent.

When contacting Customer Care to correct delivery failures, be sure to give the agent your data feed ID. This feed ID was provided by Customer Care when the data feed was initially created. If the feed ID is not available, provide the report suite ID and FTP destination.

Resend Options

If you need data for a delivery period resent, contact Customer Care. Adobe stores the generated data feed files for the previous 7 days, so if the request is made within this period data feed files can be resent without being regenerated.

Daylight Savings impact on Hourly Data Feeds

For certain time zones the time will change twice a year due to daylight saving time (DST) definitions. Data feeds honor the time zone for which the report suite is configured. If the time zone for the report suite is one that does not use DST, file delivery will continue normally like any other day. If the time zone of the report suite is one that does use DST, file delivery will be altered for the hour in which the time change occurs (usually 2:00 am).

When making STD -> DST time transitions (“Spring Forward”), the customer will only get 23 files. The hour that is skipped in the DST transition is simply omitted. For example, if the transition occurs at 2 AM, they’ll get a file for the 1:00 hour, and will get a file for the 3:00 hour. There will be no 2:00 file, since at 2:00 STD, it becomes 3:00 DST.

When making DST -> STD transitions, (“Fall Back”), the customer will get 24 files. However, the hour of transition will actually include 2 hours’ worth of data. For example, if the transition occurs at 2:00 am, the file for 1:00 will be delayed by one hour, but will contain data for two hours. It will contain data from 1:00 DST to 2:00 STD (which would have been 3:00 DST). The next file will begin at 2:00 STD.

No Data for a Time Period

You can optionally configure a data feed to deliver a manifest file if no data is collected for a specific period. If you enable this option, you'll receive a manifest file similar to the following:

Datafeed-Manifest-Version: 1.0 Lookup-Files: 0 Data-Files: 0 Total-Records: 0

Data Processing Overview

Before processing hourly or daily data, data feeds waits until all the hits that entered data collection within the timeframe (day or hour) have been written out to data warehouse. After that occurs, data feeds collects the data with timestamps that fall within the timeframe, compresses it, and sends it via FTP. For hourly feeds, files are typically written out to data warehouse within 15-30 min after the hour, but there is no set time period. If there was no data with timestamps that fall within the timeframe, then the process tries again the next timeframe. The current data feed process uses the date_time field to determine which hits belong to the hour. This field is based on the time zone of the report suite.

 

Reference: https://marketing.adobe.com/resources/help/en_US/sc/clickstream/datafeeds_troubleshooting.html

0 Replies