Alerts based on dimension values of custom metrics w/ rolling time frames

[jonathanhansen]

Hi there, I'm trying to set up an alert that will trigger based on a weighted composition value that is computed. I will include a screenshot of the math using orders, but my use case is looking at total null searches WoW and assigning a weight to how much a specific search term influenced total null searches WoW. As a result, sorting by this weight would show the null searches that should be fixed first and are influencing total null searches the most. 

The math below says orders for hotels decreased -14,100 WoW vs all departments -68,891 WoW. As a result the decrease in hotel orders is 20.2% of the total decrease. Given all departments decreased -24.3% WoW, hotels made up -4.91% of the total decrease. 

This would easily translate to null searches where if null searches went up by X%, we'd want to deal with the top Y that are greatly influencing this total number X. 

I'm confused how to set up an alert for the highlighted column below that will say if any department (or search) is over Y%, send an alert so that it can be fixed. 

Thanks!!

[Jennifer_Dungan]

Hello,

Setting up and alert based on a calculated metric is possible, and you can specify what the threshold is... 

I have a "Reload Rate" calculated metric:

and then I created an hourly alert for it:

Now, in my alert, I also have segments applied (I look only at Articles, and not any page on the site, and I set up multiple alerts... one for web and one for mobile apps).

In your case, you would need to set up a separate alert for each Department. So you would need to create a segment for "Hotels" and another for "Apartments" and so on... then make sure your Orders Weighted Comp is available in your components (and not just an ad hoc calculation).

Now, maybe I missed something, and you want your threshold to be calculated... that I don't think can be done, but maybe more of a changes by % might work for you?

This would compare the previous period to the current, if the change is more than 10% (in either direction) then send an alert.

You will just have to play to try and get something that works for you.

Good Luck

[jonathanhansen]

Thank you - I was worried it would have to be specified by department.... I was hoping to get around this because for the use case of null searches, the "department" will always be changing. 

Thanks again - 

[Jennifer_Dungan]

Changing Departments is a challenge....

What about instead of an alert, you just set up a daily or weekly digest report?

[jonathanhansen]

That is what I did with just the top 3 weights, split out by segments, shown as summary numbers. I was hoping to get around checking the report myself and just let other teams use it, and flag the big offenders with alerts...

Thank you for the back and forth though, this actually came from the 2025 Rockstars Tips and Tricks session you did at Summit :). Don't fully remember if it was your tip or not, but appreciate the help!

[Jennifer_Dungan · Accepted solution]

Yeah, I hear that... it would be nice to have some more flexibility with dynamic dimensions. I also am not a big fan of daily digests... its too easy to get complacent and not check... alerts only come when something is detected.

I mean if you really need something, a custom solution using the APIs and outside logic to email might work... but that's a lot of effort.

Glad I was able to help you, even if we don't have a full solution... but maybe this could be used to drive a feature request... 

Again, good luck.. if I think of something else to try, I will try to post back.

[ivonne221]

Hi @jonathanhansen this Medium post https://thebounce.io/best-practices-for-adobe-analytics-alerts-07b88145242f by Lukas Oldenburg can be relevant too.

Good luck