Year over Year alerts - Status changed to: Archived

[#1]

I would like the ability to set up simple year over year daily alerts. Our industry is very cyclical and/or seasonal on a daily, weekly and monthly basis. Trying to set up day over day, week over week or month over month alerts is not feasible. I have done the analysis on basic metrics; visits, transactions, etc. and I see the variance for the highs and lows for those comparisons as follows;

Day over Day: -47% to +148%

Week over Week:  -51% to +150%

Month Over Month: -71% to +142%

When I do a Year over Year (i.e. -364 days, same day of week) I get the ranges -15% to +21%,

So for us having alerts for a Year over Year day are a much more accurate measure of change and allow for setting tighter thresholds

[#2]

Thanks for the suggestion - so just to be clear, you're asking for an added granularity of "year" to be added to the alert builder (at the top where it says "Granularity")?

[#3]

What I need is to be able to create an alert that compares a metric for yesterday (single day) to the day (single day) 364 days prior. Example

Compare visits for the day Wednesday October 3 2018 to visits for the day Wednesday Oct 4 2017.

I do not need an alert that’s compares an entire year to the entire prior year. Meaning I do not need an alert that compares visits for Oct 4 2017- Oct 3 2018 to Oct 4 2016-Oct 3 2017

[#4]

Thanks for the clarification - we actually do perform YoY analysis within our Anomaly Detection algorithm, so if you have a daily alert setup to alert on anomalies, it should find those.  If it's not, it would be great to know a little bit more about your data so we can investigate.

[#5]

Interesting I wonder why know one made me aware of that given I have been trying to get something in place since last April and ultimately Adobe customer service and engineering both said its not possible to have alerts on a YoY comparison. See ticket

180418-000305 under Sabre Global company

So how would I set up the work space to have the YoY anomaly detection in place and then how to create an alert based on those anomalies?

[#6]

If you create an alert based on that normal metric, and set it to trigger on anomalies, it should automatically trigger on a YoY anomaly (it checks a bunch of things, including YoY).  So give that a try, and if it is not catching it, please let us know and we can investigate further.

[#7]

Ok so I created a very basic alert for Orders in one of our report suites. Ideally I would like to have it alert if there was more than a negative 15% change year over year. I can't set the threshold so I created the alert using a "anomaly is below expected" at a "90% threshold"

According to my data (see below) at a -15% change threshold the alert would have fired once since May 8, 2018. At a -10% change threshold the alert would have fired 4 times since May 8, 2018. And twice in the last 30 days.

I know the anomaly detection is probably a lot more complex than a simple year over year comparison but the Alert work space says the alert would have triggered only 1 time in the last 30 days. Even though the largest negative change (-24.8%) occurred 94 days ago.

So not exactly what I am looking for.

Item	Flowtype Booking (Hit) + PNRs (Bookings) + 7HDX	YoY Change
9-May-17	224	N/A
10-May-17	285	N/A
11-May-17	231	N/A
12-May-17	224	N/A
13-May-17	143	N/A
14-May-17	185	N/A
15-May-17	263	N/A
16-May-17	261	N/A
17-May-17	275	N/A
18-May-17	246	N/A
19-May-17	224	N/A
20-May-17	152	N/A
21-May-17	209	N/A
22-May-17	279	N/A
23-May-17	238	N/A
24-May-17	232	N/A
25-May-17	196	N/A
26-May-17	216	N/A
27-May-17	149	N/A
28-May-17	150	N/A
29-May-17	161	N/A
30-May-17	255	N/A
31-May-17	220	N/A
1-Jun-17	224	N/A
2-Jun-17	229	N/A
3-Jun-17	153	N/A
4-Jun-17	170	N/A
5-Jun-17	254	N/A
6-Jun-17	248	N/A
7-Jun-17	174	N/A
8-Jun-17	230	N/A
9-Jun-17	249	N/A
10-Jun-17	129	N/A
11-Jun-17	177	N/A
12-Jun-17	240	N/A
13-Jun-17	216	N/A
14-Jun-17	211	N/A
15-Jun-17	222	N/A
16-Jun-17	203	N/A
17-Jun-17	179	N/A
18-Jun-17	145	N/A
19-Jun-17	224	N/A
20-Jun-17	234	N/A
21-Jun-17	201	N/A
22-Jun-17	196	N/A
23-Jun-17	188	N/A
24-Jun-17	114	N/A
25-Jun-17	154	N/A
26-Jun-17	210	N/A
27-Jun-17	260	N/A
28-Jun-17	247	N/A
29-Jun-17	215	N/A
30-Jun-17	250	N/A
1-Jul-17	201	N/A
2-Jul-17	195	N/A
3-Jul-17	240	N/A
4-Jul-17	173	N/A
5-Jul-17	314	N/A
6-Jul-17	272	N/A
7-Jul-17	297	N/A
8-Jul-17	189	N/A
9-Jul-17	212	N/A
10-Jul-17	348	N/A
11-Jul-17	326	N/A
12-Jul-17	340	N/A
13-Jul-17	297	N/A
14-Jul-17	327	N/A
15-Jul-17	226	N/A
16-Jul-17	231	N/A
17-Jul-17	324	N/A
18-Jul-17	341	N/A
19-Jul-17	353	N/A
20-Jul-17	339	N/A
21-Jul-17	284	N/A
22-Jul-17	195	N/A
23-Jul-17	208	N/A
24-Jul-17	320	N/A
25-Jul-17	325	N/A
26-Jul-17	367	N/A
27-Jul-17	358	N/A
28-Jul-17	357	N/A
29-Jul-17	221	N/A
30-Jul-17	215	N/A
31-Jul-17	381	N/A
1-Aug-17	369	N/A
2-Aug-17	365	N/A
3-Aug-17	318	N/A
4-Aug-17	328	N/A
5-Aug-17	224	N/A
6-Aug-17	228	N/A
7-Aug-17	343	N/A
8-Aug-17	380	N/A
9-Aug-17	339	N/A
10-Aug-17	320	N/A
11-Aug-17	310	N/A
12-Aug-17	184	N/A
13-Aug-17	190	N/A
14-Aug-17	340	N/A
15-Aug-17	255	N/A
16-Aug-17	353	N/A
17-Aug-17	278	N/A
18-Aug-17	315	N/A
19-Aug-17	197	N/A
20-Aug-17	202	N/A
21-Aug-17	308	N/A
22-Aug-17	327	N/A
23-Aug-17	256	N/A
24-Aug-17	291	N/A
25-Aug-17	289	N/A
26-Aug-17	172	N/A
27-Aug-17	199	N/A
28-Aug-17	279	N/A
29-Aug-17	226	N/A
30-Aug-17	317	N/A
31-Aug-17	333	N/A
1-Sep-17	262	N/A
2-Sep-17	166	N/A
3-Sep-17	173	N/A
4-Sep-17	193	N/A
5-Sep-17	310	N/A
6-Sep-17	326	N/A
7-Sep-17	288	N/A
8-Sep-17	305	N/A
9-Sep-17	167	N/A
10-Sep-17	190	N/A
11-Sep-17	309	N/A
12-Sep-17	290	N/A
13-Sep-17	297	N/A
14-Sep-17	260	N/A
15-Sep-17	294	N/A
16-Sep-17	161	N/A
17-Sep-17	188	N/A
18-Sep-17	307	N/A
19-Sep-17	269	N/A
20-Sep-17	255	N/A
21-Sep-17	265	N/A
22-Sep-17	381	N/A
23-Sep-17	236	N/A
24-Sep-17	196	N/A
25-Sep-17	350	N/A
26-Sep-17	279	N/A
27-Sep-17	291	N/A
28-Sep-17	240	N/A
29-Sep-17	264	N/A
30-Sep-17	215	N/A
1-Oct-17	190	N/A
2-Oct-17	334	N/A
3-Oct-17	288	N/A
4-Oct-17	357	N/A
5-Oct-17	426	N/A
6-Oct-17	368	N/A
7-Oct-17	202	N/A
8-Oct-17	239	N/A
9-Oct-17	546	N/A
10-Oct-17	404	N/A
11-Oct-17	342	N/A
12-Oct-17	342	N/A
13-Oct-17	295	N/A
14-Oct-17	152	N/A
15-Oct-17	171	N/A
16-Oct-17	284	N/A
17-Oct-17	235	N/A
18-Oct-17	273	N/A
19-Oct-17	254	N/A
20-Oct-17	246	N/A
21-Oct-17	190	N/A
22-Oct-17	199	N/A
23-Oct-17	257	N/A
24-Oct-17	273	N/A
25-Oct-17	259	N/A
26-Oct-17	259	N/A
27-Oct-17	287	N/A
28-Oct-17	151	N/A
29-Oct-17	154	N/A
30-Oct-17	259	N/A
31-Oct-17	256	N/A
1-Nov-17	299	N/A
2-Nov-17	288	N/A
3-Nov-17	299	N/A
4-Nov-17	155	N/A
5-Nov-17	192	N/A
6-Nov-17	317	N/A
7-Nov-17	241	N/A
8-Nov-17	225	N/A
9-Nov-17	269	N/A
10-Nov-17	207	N/A
11-Nov-17	158	N/A
12-Nov-17	165	N/A
13-Nov-17	306	N/A
14-Nov-17	254	N/A
15-Nov-17	260	N/A
16-Nov-17	228	N/A
17-Nov-17	253	N/A
18-Nov-17	167	N/A
19-Nov-17	188	N/A
20-Nov-17	238	N/A
21-Nov-17	237	N/A
22-Nov-17	191	N/A
23-Nov-17	89	N/A
24-Nov-17	311	N/A
25-Nov-17	196	N/A
26-Nov-17	230	N/A
27-Nov-17	375	N/A
28-Nov-17	350	N/A
29-Nov-17	344	N/A
30-Nov-17	341	N/A
1-Dec-17	234	N/A
2-Dec-17	183	N/A
3-Dec-17	192	N/A
4-Dec-17	355	N/A
5-Dec-17	305	N/A
6-Dec-17	322	N/A
7-Dec-17	292	N/A
8-Dec-17	266	N/A
9-Dec-17	197	N/A
10-Dec-17	226	N/A
11-Dec-17	292	N/A
12-Dec-17	229	N/A
13-Dec-17	252	N/A
14-Dec-17	204	N/A
15-Dec-17	254	N/A
16-Dec-17	155	N/A
17-Dec-17	153	N/A
18-Dec-17	257	N/A
19-Dec-17	218	N/A
20-Dec-17	218	N/A
21-Dec-17	205	N/A
22-Dec-17	199	N/A
23-Dec-17	132	N/A
24-Dec-17	90	N/A
25-Dec-17	112	N/A
26-Dec-17	231	N/A
27-Dec-17	245	N/A
28-Dec-17	200	N/A
29-Dec-17	205	N/A
30-Dec-17	139	N/A
31-Dec-17	153	N/A
1-Jan-18	160	N/A
2-Jan-18	248	N/A
3-Jan-18	267	N/A
4-Jan-18	250	N/A
5-Jan-18	245	N/A
6-Jan-18	157	N/A
7-Jan-18	162	N/A
8-Jan-18	284	N/A
9-Jan-18	270	N/A
10-Jan-18	250	N/A
11-Jan-18	236	N/A
12-Jan-18	263	N/A
13-Jan-18	143	N/A
14-Jan-18	143	N/A
15-Jan-18	229	N/A
16-Jan-18	314	N/A
17-Jan-18	269	N/A
18-Jan-18	238	N/A
19-Jan-18	231	N/A
20-Jan-18	140	N/A
21-Jan-18	126	N/A
22-Jan-18	246	N/A
23-Jan-18	230	N/A
24-Jan-18	238	N/A
25-Jan-18	234	N/A
26-Jan-18	209	N/A
27-Jan-18	112	N/A
28-Jan-18	144	N/A
29-Jan-18	271	N/A
30-Jan-18	264	N/A
31-Jan-18	248	N/A
1-Feb-18	226	N/A
2-Feb-18	255	N/A
3-Feb-18	137	N/A
4-Feb-18	151	N/A
5-Feb-18	262	N/A
6-Feb-18	245	N/A
7-Feb-18	249	N/A
8-Feb-18	240	N/A
9-Feb-18	248	N/A
10-Feb-18	152	N/A
11-Feb-18	205	N/A
12-Feb-18	300	N/A
13-Feb-18	281	N/A
14-Feb-18	241	N/A
15-Feb-18	235	N/A
16-Feb-18	248	N/A
17-Feb-18	166	N/A
18-Feb-18	184	N/A
19-Feb-18	224	N/A
20-Feb-18	244	N/A
21-Feb-18	255	N/A
22-Feb-18	285	N/A
23-Feb-18	277	N/A
24-Feb-18	191	N/A
25-Feb-18	178	N/A
26-Feb-18	325	N/A
27-Feb-18	332	N/A
28-Feb-18	285	N/A
1-Mar-18	309	N/A
2-Mar-18	270	N/A
3-Mar-18	184	N/A
4-Mar-18	194	N/A
5-Mar-18	300	N/A
6-Mar-18	270	N/A
7-Mar-18	294	N/A
8-Mar-18	310	N/A
9-Mar-18	267	N/A
10-Mar-18	180	N/A
11-Mar-18	164	N/A
12-Mar-18	303	N/A
13-Mar-18	292	N/A
14-Mar-18	282	N/A
15-Mar-18	273	N/A
16-Mar-18	271	N/A
17-Mar-18	181	N/A
18-Mar-18	190	N/A
19-Mar-18	300	N/A
20-Mar-18	296	N/A
21-Mar-18	280	N/A
22-Mar-18	238	N/A
23-Mar-18	237	N/A
24-Mar-18	159	N/A
25-Mar-18	187	N/A
26-Mar-18	380	N/A
27-Mar-18	329	N/A
28-Mar-18	264	N/A
29-Mar-18	281	N/A
30-Mar-18	250	N/A
31-Mar-18	199	N/A
1-Apr-18	184	N/A
2-Apr-18	398	N/A
3-Apr-18	348	N/A
4-Apr-18	367	N/A
5-Apr-18	321	N/A
6-Apr-18	307	N/A
7-Apr-18	203	N/A
8-Apr-18	225	N/A
9-Apr-18	313	N/A
10-Apr-18	253	N/A
11-Apr-18	275	N/A
12-Apr-18	283	N/A
13-Apr-18	255	N/A
14-Apr-18	171	N/A
15-Apr-18	204	N/A
16-Apr-18	340	N/A
17-Apr-18	321	N/A
18-Apr-18	295	N/A
19-Apr-18	241	N/A
20-Apr-18	241	N/A
21-Apr-18	156	N/A
22-Apr-18	227	N/A
23-Apr-18	328	N/A
24-Apr-18	268	N/A
25-Apr-18	250	N/A
26-Apr-18	258	N/A
27-Apr-18	278	N/A
28-Apr-18	160	N/A
29-Apr-18	188	N/A
30-Apr-18	337	N/A
1-May-18	330	N/A
2-May-18	280	N/A
3-May-18	325	N/A
4-May-18	327	N/A
5-May-18	143	N/A
6-May-18	195	N/A
7-May-18	376	N/A
8-May-18	346	54.5%
9-May-18	361	26.7%
10-May-18	328	42.0%
11-May-18	294	31.3%
12-May-18	208	45.5%
13-May-18	190	2.7%
14-May-18	437	66.2%
15-May-18	392	50.2%
16-May-18	347	26.2%
17-May-18	345	40.2%
18-May-18	352	57.1%
19-May-18	230	51.3%
20-May-18	254	21.5%
21-May-18	439	57.3%
22-May-18	357	50.0%
23-May-18	359	54.7%
24-May-18	385	96.4%
25-May-18	400	85.2%
26-May-18	209	40.3%
27-May-18	237	58.0%
28-May-18	238	47.8%
29-May-18	382	49.8%
30-May-18	339	54.1%
31-May-18	303	35.3%
1-Jun-18	309	34.9%
2-Jun-18	193	26.1%
3-Jun-18	211	24.1%
4-Jun-18	345	35.8%
5-Jun-18	349	40.7%
6-Jun-18	355	104.0%
7-Jun-18	286	24.3%
8-Jun-18	330	32.5%
9-Jun-18	193	49.6%
10-Jun-18	222	25.4%
11-Jun-18	467	94.6%
12-Jun-18	397	83.8%
13-Jun-18	346	64.0%
14-Jun-18	356	60.4%
15-Jun-18	388	91.1%
16-Jun-18	268	49.7%
17-Jun-18	242	66.9%
18-Jun-18	377	68.3%
19-Jun-18	380	62.4%
20-Jun-18	337	67.7%
21-Jun-18	326	66.3%
22-Jun-18	327	73.9%
23-Jun-18	212	86.0%
24-Jun-18	227	47.4%
25-Jun-18	363	72.9%
26-Jun-18	369	41.9%
27-Jun-18	391	58.3%
28-Jun-18	358	66.5%
29-Jun-18	350	40.0%
30-Jun-18	227	12.9%
1-Jul-18	240	23.1%
2-Jul-18	349	45.4%
3-Jul-18	309	78.6%
4-Jul-18	236	-24.8%
5-Jul-18	324	19.1%
6-Jul-18	358	20.5%
7-Jul-18	220	16.4%
8-Jul-18	256	20.8%
9-Jul-18	476	36.8%
10-Jul-18	420	28.8%
11-Jul-18	419	23.2%
12-Jul-18	373	25.6%
13-Jul-18	397	21.4%
14-Jul-18	223	-1.3%
15-Jul-18	255	10.4%
16-Jul-18	493	52.2%
17-Jul-18	448	31.4%
18-Jul-18	432	22.4%
19-Jul-18	446	31.6%
20-Jul-18	444	56.3%
21-Jul-18	236	21.0%
22-Jul-18	279	34.1%
23-Jul-18	482	50.6%
24-Jul-18	483	48.6%
25-Jul-18	462	25.9%
26-Jul-18	433	20.9%
27-Jul-18	358	0.3%
28-Jul-18	238	7.7%
29-Jul-18	259	20.5%
30-Jul-18	486	27.6%
31-Jul-18	462	25.2%
1-Aug-18	436	19.5%
2-Aug-18	417	31.1%
3-Aug-18	421	28.4%
4-Aug-18	213	-4.9%
5-Aug-18	268	17.5%
6-Aug-18	485	41.4%
7-Aug-18	491	29.2%
8-Aug-18	439	29.5%
9-Aug-18	461	44.1%
10-Aug-18	372	20.0%
11-Aug-18	209	13.6%
12-Aug-18	275	44.7%
13-Aug-18	524	54.1%
14-Aug-18	397	55.7%
15-Aug-18	505	43.1%
16-Aug-18	408	46.8%
17-Aug-18	445	41.3%
18-Aug-18	242	22.8%
19-Aug-18	291	44.1%
20-Aug-18	443	43.8%
21-Aug-18	450	37.6%
22-Aug-18	464	81.3%
23-Aug-18	380	30.6%
24-Aug-18	513	77.5%
25-Aug-18	219	27.3%
26-Aug-18	290	45.7%
27-Aug-18	463	65.9%
28-Aug-18	359	58.8%
29-Aug-18	328	3.5%
30-Aug-18	364	9.3%
31-Aug-18	383	46.2%
1-Sep-18	143	-13.9%
2-Sep-18	172	-0.6%
3-Sep-18	206	6.7%
4-Sep-18	444	43.2%
5-Sep-18	470	44.2%
6-Sep-18	392	36.1%
7-Sep-18	410	34.4%
8-Sep-18	198	18.6%
9-Sep-18	189	-0.5%
10-Sep-18	538	74.1%
11-Sep-18	464	60.0%
12-Sep-18	379	27.6%
13-Sep-18	366	40.8%
14-Sep-18	347	18.0%
15-Sep-18	202	25.5%
16-Sep-18	214	13.8%
17-Sep-18	435	41.7%
18-Sep-18	419	55.8%
19-Sep-18	362	42.0%
20-Sep-18	349	31.7%
21-Sep-18	413	8.4%
22-Sep-18	205	-13.1%
23-Sep-18	212	8.2%
24-Sep-18	481	37.4%
25-Sep-18	426	52.7%
26-Sep-18	389	33.7%
27-Sep-18	359	49.6%
28-Sep-18	403	52.7%
29-Sep-18	192	-10.7%
30-Sep-18	234	23.2%
1-Oct-18	466	39.5%
2-Oct-18	484	68.1%
3-Oct-18	462	29.4%
4-Oct-18	718	68.5%
5-Oct-18	563	53.0%
6-Oct-18	269	33.2%
7-Oct-18	337	41.0%

[#8]

So you are hoping it would trigger more often?  (ie, to match your table) - is that correct?

[#9]

So a couple of comments, I was merely responding to your comment

"If you create an alert based on that normal metric, and set it to trigger on anomalies, it should automatically trigger on a YoY anomoly"

I set up the work space as stated above and the "Preview" indicated the alert would have triggered 1 time in the prior 30 days. But my data looks as though it should have been triggered twice on a year over year basis.

Secondly, how can I be certain the anomaly flagged is for a year over year comparison as opposed to a possible day over day, week over week or month over month comparison?

It really doesn't seem like it would be that difficult to build in the functionality specifically to have a year over year threshold.

Everywhere I have ever worked (Ecommerce related) we always put more credence and value to a year over year comparison than any other comparison mostly due to the seasonality of our industry over the course of a days, weeks or months. Year over year we see the nearly identical metrics on a daily basis (+/-15% compared to a range of -70% to +150% using any other time comparison)

[#10]

Thank you for all of this detail.  We do many things in our anomaly detection algorithm, YoY comparison is one of them.  It *should* detect these things for you, and if it's not, we can investigate.  Currently, we don't allow for more granular dissection of the anomaly detection algorithm, but we can certainly consider it (or something like it) for the future.  We will pass this information (your above details) to our data science team to investigate.  Thank you!