Number of lines in my datawarehouse export is not aligned with the workspace figures

[robinl39529461]

Hi, 
I have some scheduled exports defined to run each morning at 2AM about data of the previous day.
I noticed that sometimes the export is incomplete and sometimes it's ok.

To validate this, I scheduled (at the same time as the DWH export) a report to be sent  on the segment containing the data to extract.
So without any modification, the result can change by day.

EX : 
report send on the 14/10 (so about data of the previous day)

Segment definition:

The export about this day:

and the number of lines in the file:

So some day it's ok and some day not ....

Did you already see this kind of behavior ?

Do you know if there is option in DWH to help by sending automatically info of the number of lines in the file ?

Thanks

Robin

[Jennifer_Dungan]

With Data Warehouse export, this is a flattened table.. if you have anything like a list variable or a product or something that results in needing multiple rows to represent the data, then that will cause additional rows to appear... Even something like having Visit or Unique Visitor metrics in the Data Warehouse export, where maybe the user updated their browser, or changed something within the visit, each variant will show on a different line...

Your Workspace just has one consolidated, de-duplicated total.... your Data Warehouse is not de-duplicated, and is showing a lot more columns of data increasing the change of divergence...

Now, on the opposite side of things, you are using the Occurrences metric in Workspace... this metric isn't supported in Data Warehouse (unless that's added in the new UI which I don't have yet...)

But on the surface, these don't seem like comparable reports....

[robinl39529461]

Thanks Jennifer for your answer.

In my export I don't request any metric to be present and one dimension used ensures unicity of the data, so no issue (theorically) with duplication.
That's the reason why I used occurences in my report.

But as said, majority of time, it's aligned but in some cases there is a huge difference between the report and the export.

I think it will be so much easier it here is any option in DWH to receive a report on the export with the number of lines.

I try play with the following options in the new interface:

As result I have this:

with details:

but the number of lines announced in not in line with the file itself: 

So I'm a bit lost ...

Robin

[robinl39529461 · Accepted solution]

I think I found it.

With only using this option in the export:

So without the digital signature file, the info looks OK :

And with this now it seems ok:

and it's aligned with the quantities of the file (without the header):

So it seems OK

Robin

[Jennifer_Dungan]

Excellent, I'm glad you found a solution!


For the record, I don't have the new IU yet, so I don't have those options... good to know there is some cool functionality coming soon.

[SrikrishnaChaitanya]

Hi Robinl

One thing to notice that, The Excluded bucket will not be working in Data Whareshouse. So, Please try to create the segment with out exclude and try.

[robinl39529461]

Hi,

thank for your feedback.
When you said 'will not be working', do you mean that the segment is not compatible with DWH?
Because this segment is available for DWH export:

and my exports run (but sometimes with inconsistance result)

Excluding the session make it not compatible with DWH but I found a workaround:

in place of excluding the session directly, I exclude all hits of the session I want to exclude:

I compare result in the workspace inteface by creating 2 segments:
- excluding a visit

- excluding all hits of a visit

And it gives the same result.

Robin

[Jennifer_Dungan]

Yeah, I would expect if any part didn't work with Data Warehouse, the compatibility would reflect that...  this looks fine to me.