What is the maximum file size used in the data loading activity and how to increase time limit for uploading data in campaign server? | Community
Skip to main content
nithyanandhanm4
nithyanandhanm4
Level 2
January 3, 2017
Solved

What is the maximum file size used in the data loading activity and how to increase time limit for uploading data in campaign server?

  • January 3, 2017
  • 1 reply
  • 3396 views

Hi Team,

We are uploading 4.5 GB data into campaign server using data loading activity. Also we need to process the file and insert data into schema.

We are facing some errors while uploading data into server.

Also we tried moving file to campaign server using SSH and used File collector to process it. This approach also facing too much time while executing the workflow.

Is there any option for increasing time limit in data loading activity?

Is there any maximum file size restriction in campaign server?

Let us know the best practice to process bulk files.

This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.
Best answer by vraghav

Hi,

Uploading huge files on to the server using the File Upload functionality is not recommended.

You need to place this file on sFTP and then using File Collector provide the file to Data Loading activity.

Since the file is huge, it will take some time to process. The only possible way to reduce time will be to use multiple workflows and break this file into smaller chunks.

Use each such workflow to process one chunk. This method will provide you some sort of parallelism but eventually the data is being inserted inside the same database/table. You will see a performance improvement with concurrent workflows.

When using the sFTP way of uploading to data loading, there is no file size restriction.

Hope this helps

1 reply

vraghav
Adobe Employee
vraghavAdobe EmployeeAccepted solution
Adobe Employee
January 3, 2017

Hi,

Uploading huge files on to the server using the File Upload functionality is not recommended.

You need to place this file on sFTP and then using File Collector provide the file to Data Loading activity.

Since the file is huge, it will take some time to process. The only possible way to reduce time will be to use multiple workflows and break this file into smaller chunks.

Use each such workflow to process one chunk. This method will provide you some sort of parallelism but eventually the data is being inserted inside the same database/table. You will see a performance improvement with concurrent workflows.

When using the sFTP way of uploading to data loading, there is no file size restriction.

Hope this helps

    Terms & ConditionsAccessibility statement

    Loading footer...