Ability to query raw hits

Avatar

Avatar

cathymorse-PyyH

Avatar

cathymorse-PyyH

cathymorse-PyyH

29-04-2014

For QA and troubleshooting purposes, I often need to see the raw hit data -- similar to what is sent over in our daily raw data feeds.  I wish there was a way for me to extract certain columns based on my filters.  For example, show me visits where there was a purchase and no checkout method type so I can see why that might be falling off.

7 Comments (7 New)
7 Comments

Avatar

Avatar

joshd7227840

MVP

Avatar

joshd7227840

MVP

joshd7227840
MVP

29-04-2014

The example you mentioned is a bit more complex than that though.. "visit" is an arbitrary concept that must be applied to the data.  They would essentially be replicating what they already do so that you can get reports.  This is exactly what the reports or api already give you.  IOW this is already implemented through the report interface and api. 

 

The only advantage to getting the raw hit data is to see what Adobe received before they do anything to it. 

 

I give a +1 though because maybe it will at least lead to gaining on-demand/api access to the raw hit data, instead of having to make a request to ClientCare.

Avatar

Avatar

benjamingaines2

Avatar

benjamingaines2

benjamingaines2

30-04-2014

@_josh and @CathyMorse : Great suggestion. Some help in this area is coming soon with the release of a new API that provides hit-level data based on rules that you specify. If you attended Adobe Summit in Utah last month you may have seen this data featured in several of the main-stage presentations and sneaks. I'm going to mark this as "In Progress" and then in the new API doesn't look like what you need once it has been released (at which point I will mark this as "Implemented"), just comment here and let us know. 

Avatar

Avatar

benjamingaines2

Avatar

benjamingaines2

benjamingaines2

30-04-2014

Avatar

Avatar

cathymorse-PyyH

Avatar

cathymorse-PyyH

cathymorse-PyyH

30-04-2014

Thanks Ben.  That's great news.  So will there be a filtering UI that lets someone pull raw hits without knowing any SQL, etc.?  Right now my challenge is that I have to go to someone who knows Hive in order to get sample hits.  I'd like to just specify fields in a simple UI.  @Josh, totally agree that visits is a complicated thing to associate in raw hits. It requires that you add logic that says for a given vis_id that contained hits that meet X, Y, Z criteria, pull all the hits associated with that vis_id.  I find raw data super helpful in looking at individual hits and paths to try and diagnose how a particular tag didn't report correctly.  It's like session replay.  Raw data also gives me access to super granular data like IP and user agent, that might otherwise be truncated with the 500K row limit.  When I'm looking for small edge cases, having access to all the data is super helpful (I'm dealing with millions of visits/day).

Avatar

Avatar

benjamingaines2

Avatar

benjamingaines2

benjamingaines2

30-04-2014

@CathyMorse : Well, it's an API, so some technical proficiency is required in order to receive the data. I'm not sure whether there is a UI that allows you to select the fields and define the rules, or whether that is also done programmatically. I can try to find out. 

Avatar

Avatar

benjamingaines2

Avatar

benjamingaines2

benjamingaines2

22-05-2014

This is now available with the Adobe Analytics Spring 2014 release! The feature (Live Stream) is currently available only to Adobe Analytics Premium customers, so I am marking this as partially implemented. We will continue to improve your ability to access raw data for users of both Adobe Analytics Standard and Adobe Analytics Premium.

Avatar

Avatar

billy09265

Avatar

billy09265

billy09265

16-06-2014

Thanks Ben.

Adding +1 for "continue to improve your ability to access raw data for users of both Adobe Analytics Standard"