Data Warehouse API returning inflated data

[chrisalvarespmg]

As of Saturday, any request made using the Data Warehouse API's Report.Queue has been returning considerably more data (roughly 10x more rows), inflating numbers when selecting more than 3 dimensions. When duplicating the report inside of Data Warehouse and setting the target to "email", the numbers return to normal, however, any request made using the API returns significantly more data.

[Ankit_Sharma_ · Accepted solution]

@chrisalvarespmg  Can you provide more details, like what request you are making from data warehouse API and response you are getting that will help us in debugging the issue. 

[chrisalvarespmg]

@ankits28281247 posted as another comment.

[Ankit_Sharma_]

@chrisalvarespmg A hotfix is in place, we should have it in place tomorrow or Monday next week, will keep you posted.

[chrisalvarespmg]

Thank you @Ankit_Sharma_, please keep me posted as we will need to switch our systems back to pulling multiple pages when this is implemented.

[Ankit_Sharma_]

@chrisalvarespmg This issue is fixed and went live yesterday, please try re-running your report.

[chrisalvarespmg]

Here is the request: 

Report.Queue: 

"reportDescription": {

    "reportSuiteID": "<redacted>",

    "dateFrom": "2020-09-08",

    "dateTo": "2020-09-13",

    "dateGranularity": "day",

    "metrics": [{

        "id": "revenue"

    },

    {

        "id": "visits"

    },

    {

        "id": "orders"

    },

    {

        "id": "allvisitors"

    }],

    "elements": [

    {

        "id": "mobiledevicetype",

        "everythingElse": true

    },

    {

        "id": "evar1",

        "everythingElse": true

    },

    {

        "id": "referringdomain",

        "everythingElse": true

    },

    {

        "id": "trackingcode",

        "everythingElse": true

    },

    {

        "id": "visitnumber",

        "everythingElse": true

    }],

    "locale": "en_US",

    "currentData": true,

    "source": "warehouse",

    "elementDataEncoding": "utf8"

    }

}

Report.Get 
{
     "reportId": "<redacted>"
     "format": "csv",
     "page": 1 //1,2,3,4,5,6,7, etc
}

[Ankit_Sharma_]

need some more clarity and required further troubleshooting, do you have access to customercare or if you can share you email address we can get support ticket created for you.

[chrisalvarespmg]

@Ankit_Sharma_ sent you a DM, but in case it didn't go through, my email is chris.alvares@pmg.com

[Ankit_Sharma_]

This turned out to be an known issue, it seems the data is getting duplicated from page 3,4 onward and sending the copy of entire file. I'll update you once this is fix.

[pmgp52464762]

@Ankit_Sharma_ that is great news. Is there an ETA for a fix? We need to know if we should implement a temp solution where we just read page 3 instead of paginate through the list if that is actually the issue.

[Ankit_Sharma_]

@pmgp52464762 unfortunately I don't think there is a fix, This is being work upon, will update this thread as soon as fix is in place.

[Khurshid_Alam]

Can you try without currentData? May be that is causing the issue.

[jantzen_b]

Do any of the answers below answer your initial question? If so, can you select one of them as the correct answer? If none of the answers already provided answer your question, can you provide additional information to better help the community solve your question?

[sobhacrystalhome]

Hi @Ankit_Sharma_ , nice posting.