I am loving Anomaly Detection and Contribution Analysis. As a feature this is such a helpful thing to have, and I know we'll engage with it often. However, I've noticed there are a few hiccups / usability issues that could improve use of the tool:
- Sometimes I can't click an anomaly in the timeline and have it show below, and it's not entirely clear why
- When I open up the Analysis Queue (which is a little hard to see, honestly), the middle anomaly detection report is only partially fluid to that menu, so although the graphs change in scale, the date-range selector gets partially covered. I think that could get simplified to a single calendar icon so it all fits on-screen (1280 width here)
- When there are no anomalies found, I would really like to see that metric/those metrics trended so I can validate for myself / check if I should be more sensitive witih my training period. I realize that doesn't fit with the current user flow (see anomaly, click, then see metric trended with anomalies.) However, when looking at a metric that gets counted millions of times a month and certainly has inorganic shifts, it's hard to believe when only an error message is returned and no data. Then I need to pop over into a metric report to observe highs and lows, and ruin my flow.
- In contribution analysis, I really wish I could rename completed reports to something else, as I have to hover and peck to find ones that have already been completed (and, if I change my dimension criteria but look at an anomaly on the same metric and same day, it's impossible to tell them apart.)
- Sometimes I hover over an anomaly in the timeline and its caption shifts to the left or right (but it always looks like the caption is pointing to the right)
- I would REALLY love to use calculated metrics in here! This is a great start, but calculated metrics are where you really see shifts in behavior.
Overall, though, I am very happy! Please continue to work on tools like this, that bring faster insight out of our data!