Your achievements

Level 1

0% to

Level 2

Tip /
Sign in

Sign in to Community

to gain points, level up, and earn exciting badges like the new
BedrockMission!

Learn More

View all

Sign in to view all badges

What was the maximum limit of files can be loaded in import workflow per run in ACS

Avatar

Avatar
Validate 1
Level 1
sivaramakumar_P
Level 1

Likes

2 likes

Total Posts

20 posts

Correct Reply

0 solutions
Top badges earned
Validate 1
Boost 1
View profile

Avatar
Validate 1
Level 1
sivaramakumar_P
Level 1

Likes

2 likes

Total Posts

20 posts

Correct Reply

0 solutions
Top badges earned
Validate 1
Boost 1
View profile
sivaramakumar_P
Level 1

17-04-2018

Hi All,

Currently I was facing issues in ACS import jobs when ever more than 1000 files loading in a single run.

My import workflow has one transfter activity to pick files from external SFTP, load activity to match the data types,enrichment to redirect values ,split and update activity alone.

As per my observation if single file is comming in an hour with 2Million records there is no issues but if multiple files like 1000 comes in a single run the job getting hangged running for 1-2 days and getting failed.

As there is no scripts  available to code to pick first 50 files from SFTP in ACS we just scheduling every one hour to pick the files but if the number of files increase per run its creating issue like workflow hang.

Can some provide a better solution for it and confirm me what could be the maximum limit of files per run of any import workflow where load,enrichment,split and update activities will work properly.

Thanks,

Sivaramakumar P

View Entire Topic

Avatar

Avatar
Validate 1
Level 2
vikashg34827223
Level 2

Likes

2 likes

Total Posts

28 posts

Correct Reply

2 solutions
Top badges earned
Validate 1
Give Back
Boost 1
Affirm 1
View profile

Avatar
Validate 1
Level 2
vikashg34827223
Level 2

Likes

2 likes

Total Posts

28 posts

Correct Reply

2 solutions
Top badges earned
Validate 1
Give Back
Boost 1
Affirm 1
View profile
vikashg34827223
Level 2

05-12-2019

Hi Siva/Florent,

In our project we want to execute multiple files at a time. We will have atmost 30 files in a single run.  But we are not able to achieve the processing of multiple files. it is executing just one file even though all the files are downloaded by Transfer File Activity.

Thanks!!
Vikash