Expand my Community achievements bar.

Webinar: Adobe Customer Journey Analytics Product Innovations: A Quarterly Overview. Come learn for the Adobe Analytics Product team who will be covering AJO reporting, Graph-based Stitching, guided analysis for CJA, and more!

Alerts - Is there a recommended threshold or best practice when choosing what threshold to set for the alerts?

Avatar

Level 2

We are looking for some best practice to determine what threshold we should set the alerts.

Topics

Topics help categorize Community content and increase your ability to discover relevant content.

4 Replies

Avatar

Level 7

@user70977  not aware of any specifics here however based on the use case/ business KPIs consider having static alerts may be critical to avoid unnecessary to many notifications 

Avatar

Community Advisor

The longer you have captured data, the more accurate the predictions for anomalies will become. If you just started capturing data, I would recommend looking at the preview at the top right how often an alert would have triggered over the last 30 days and adjust your threshold accordingly.

You can always adjust it later as needed

Cheers from Switzerland!

Avatar

Community Advisor and Adobe Champion

The best practice is to test and modify as needed. It's very likely that the first set-up for your alerts will need to be modified at least once, especially if you don't have a lot of historical data captured yet. Also, getting the sensitivity right is important. Something might be an anomaly - but is it worth looking into? It depends on your individual business, so it'll take some time to find that right level. If you get alerts too frequently, people will stop paying attention to them. If you don't get them often enough, you might miss some important events.

 

Other than that, it's really going to depend heavily on your website traffic. Do you see big fluctuations based on seasonality? Then it might be better to use the 'anomaly exists' with 90/95/99% thresholds instead of static numbers that you would have to update with each new season. But if your traffic is stable year-round, then static numbers could be the way to go. 

 

You can also use relative metrics instead of absolute. For example, instead of saying orders is below X amount, measure conversion rate. Or measure ATC rate instead of actual cart adds. Relative metrics can tell you a very different story than absolute numbers. You can also set up alerts for both types of metrics. 

 

The other suggestion I have is to set up segments to exclude time periods you don't want to get alerts for. If you set up an hourly alert, it's going to check every hour for an anomaly. But if your traffic drops overnight (when everyone is asleep), it's more likely you'll get false positives. What I've done is make segments that exclude the hours between 11pm and 5am, that way we don't get false positives. 

Avatar

Community Advisor

@user70977 As other mentioned, it is always depends on your requirements and how much variance you want to accept. Take a look at the below article for best practices and thresholds.

https://thebounce.io/best-practices-for-adobe-analytics-alerts-07b88145242f