Splitting of workflow to avoid wait activity | Community
Skip to main content
R
Ramaswami
Level 4
May 20, 2020
Solved

Splitting of workflow to avoid wait activity

  • May 20, 2020
  • 3 replies
  • 10649 views

Hi Team,

We have some hundreds of workflows running in parallel everyday through a schedular activity which is triggered daily.
So each of these workflows having a wait activity in between the workflow like below:

 

 

 

The wait period is around 2 days due to which number of concurrent workflows is exceeding the limit which is specified as every workflow has a wait activity it continuously holding the execution.

So our idea is to split up the workflow into two
1. first workflow will run only up to the email activity 1 and then sends the export of recipient results to some S3 bucket.
2. the next workflow will pickup the recipient results from S3 bucket after two days and will process the next execution( that is sending the next email).

Here my problem is i have exported the results in csv format to S3 bucket sucessfully so part 1 is done.
part 2: i have downloaded the recipient file from S3 bucket and when i am loading the data and sending the results to continously delivery. it is throwing the below error:

Part 1: Extracting the results and sending email and storing the result file in S3 bucket: which went sucessfully

 

part 2: 

 

I am downing the file with columns used as additional data in part 1 and uploading the data in part 2. i am using update data activity in order to linkup the targetting columns with recipient table and then sending an email. it should send only 4 emails but it is continously sending me emails like 20,21,22 and so on. 

 

When i don't use the update data activity. i am getting an error like below : 

if i dont use update data activity : My data loading result will be like this : 

and i will feed this to continous delivery i am getting this erro: 

Let me know if any ready made solution or any alternative we have for this. 

 

 

hi @milan_vucetic 

 

i have followed your second suggestion. kept a intersection query with data loading query: 

 

 

So i am getting the below error : 

 

Am i doing mistake anywhere. i guess this intersection takes some time as the intersection query should run all the records first and then intersect with the temp table. 

 

 

 

 

 

This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.
Best answer by Marcel_Szimonisz

Hello @ramaswami,

I have skimmed over the question and it seems like you do not have the targeting dimension (recipient table linked to your working table) you cannot send an email from a file this way.

The error is also self explanatory that your targeting data are not type of nms:recipient, and which are awaited by the delivery (set by target mapping)

 

Note:

You  always will need to reconcile the file data  with adobe campaign table eg. recipient. if you want to use unions, intersections, change dimensions...

 

Note2:

why you just do not query delivery log table in the second workflow. The query could look like:

  • everybody who got the email 1  two days ago
    • DateOnly(logDate) == DateOnly(DaysAgo(2))
  • in case no results create test activity to check on vars.recCount > 0
  • put it on scheduler to run daily.

 

Note3:

control group can be easily set on the delivery template level, also it is easily accessible by query after wards from exclusion logs

 

Marcel

3 replies

Marcel_Szimonisz
Community Advisor
Marcel_SzimoniszCommunity AdvisorAccepted solution
Community Advisor
May 21, 2020

Hello @ramaswami,

I have skimmed over the question and it seems like you do not have the targeting dimension (recipient table linked to your working table) you cannot send an email from a file this way.

The error is also self explanatory that your targeting data are not type of nms:recipient, and which are awaited by the delivery (set by target mapping)

 

Note:

You  always will need to reconcile the file data  with adobe campaign table eg. recipient. if you want to use unions, intersections, change dimensions...

 

Note2:

why you just do not query delivery log table in the second workflow. The query could look like:

  • everybody who got the email 1  two days ago
    • DateOnly(logDate) == DateOnly(DaysAgo(2))
  • in case no results create test activity to check on vars.recCount > 0
  • put it on scheduler to run daily.

 

Note3:

control group can be easily set on the delivery template level, also it is easily accessible by query after wards from exclusion logs

 

Marcel

Marcel_Szimonisz
Community Advisor
Marcel_SzimoniszCommunity Advisor
Community Advisor
May 24, 2020
you do not have to as the email one is stored in delivery logs you only need to query delivery logs where the date sent was 2 days ago and the message has been delivered.. and if you query zero recipient just create zero population check with test activity. There is no need to use any Javascript or saving dates its simple.. if email 1 was sent 2 days ago sent second email thats it 🙂
Milan_Vucetic
Milan_Vucetic
Level 9
May 21, 2020

Hi @ramaswami ,

 

based on your preferences you can:

  • use node Change dimension node in order to switch to preferred targeting dimension (from temp:fileImport to nms:recipient)
  • use Intersection node and intersect between downloaded file and nms:recipient table before delivery
  • use External file () target mapping which allows you to send email to the customers which do not exist in nms:recipient table (in your case they exist but they are not reconciled) 

Take care about data types to avoid these errors Not valid integer. This will break your workflows often.

 

Regards,

Milan

 

R
RamaswamiAuthor
Level 4
May 22, 2020
hi @2897273, thanks for the reply. I have tried your second suggestion and can you see my observations in the my asked question (bottom of the question). Also can you eloborate option 1: use node Change dimension node in order to switch to preferred targeting dimension (from temp:fileImport to nms:recipient) i guess option 1 will be simpler.
Marcel_Szimonisz
Community Advisor
Marcel_SzimoniszCommunity Advisor
Community Advisor
May 24, 2020
you cannot do intersection on table without targeting dimension aka recipient you need to reconcile first with recipient table. change dimension wont help either
Terms & ConditionsAccessibility statement

Loading footer...