Do Processing Rules effect Data Warehouse?

Avatar

Avatar
Validate 1
Level 1
erichami
Level 1

Likes

0 likes

Total Posts

19 posts

Correct reply

0 solutions
Top badges earned
Validate 1
Give Back 3
Give Back
Applaud 5
View profile

Avatar
Validate 1
Level 1
erichami
Level 1

Likes

0 likes

Total Posts

19 posts

Correct reply

0 solutions
Top badges earned
Validate 1
Give Back 3
Give Back
Applaud 5
View profile
erichami
Level 1

21-09-2020

Do Processing Rules effect Data Warehouse? I once had a processing rule which filtered out all numeric digits from all clicks.  We created this rule to avoid collecting account numbers (PII).  This processing rule worked as designed as no numeric digits appeared in UI data.  I was horrified to find account numbers in Data Warehouse as Data Warehouse ignored my processing rules.

Accepted Solutions (1)

Accepted Solutions (1)

Avatar

Avatar
Affirm 100
Employee
ishans52004352
Employee

Likes

155 likes

Total Posts

328 posts

Correct reply

104 solutions
Top badges earned
Affirm 100
Give Back 10
Give Back 5
Give Back 3
Give Back
View profile

Avatar
Affirm 100
Employee
ishans52004352
Employee

Likes

155 likes

Total Posts

328 posts

Correct reply

104 solutions
Top badges earned
Affirm 100
Give Back 10
Give Back 5
Give Back 3
Give Back
View profile
ishans52004352
Employee

22-09-2020

Processing Rules are applied before Data Warehouse extracts. It's likely something was overlooked. Could you please check or run tests again?

Answers (1)

Answers (1)

Avatar

Avatar
Seeker
Level 3
jkm-disco
Level 3

Likes

24 likes

Total Posts

130 posts

Correct reply

15 solutions
Top badges earned
Seeker
Contributor
Shape 1
Give Back
Affirm 10
View profile

Avatar
Seeker
Level 3
jkm-disco
Level 3

Likes

24 likes

Total Posts

130 posts

Correct reply

15 solutions
Top badges earned
Seeker
Contributor
Shape 1
Give Back
Affirm 10
View profile
jkm-disco
Level 3

21-09-2020

Now that I think about it, Data Warehouse must be available only after processing, since it includes values that are only set during processing (e.g. context data). It seems most likely that the conditional rule is failing. You may also want to do a Data Feed export on the variable(s) in question to compare the pre/post variable values to see how they were processed and if things are making it past the filtering processing rule.