Can Sling Post Servlet handle huge upload of assets ( 1.2 terabyte)

Sling Post Servlet should be able to handle this kind of upload.

I have used Webdav for this purpose to successfully upload over 25 GB assets to AEM DAM. You might want to explore that for your usecase. Just remember to disable all DAM related workflows as those are the real memory hogs during rendition generation.

For page content AEM packages are suited, though packages over 2GB are not recommended.

- Ashish

Is your sevlet handing a lot of files or a few big ones. Either way, this all depends on different factors. For starters, the processing power of the server running AEM and the Java libs you use within the servlet to handle file upload. I would recommend using the API mentioned here:

http://www.jedi.be/blog/2009/04/10/java-servlets-and-large-large-file-uploads-enter-apache-fileupload/

As far as a file limit - it would be best to test this in your own environment. I doubt you will find a documented limit of a upload file size an AEM servlet can handle. 

smacdonald2008 wrote...

Is your sevelt handing a lot of files or a few big ones. Either way, this all depends on different factors. For starters, the processing power of the server running AEM and the Java libs you use within the servlet to handle file upload. I would recommend using the API mentioned here:

http://www.jedi.be/blog/2009/04/10/java-servlets-and-large-large-file-uploads-enter-apache-fileupload/

As far as a file limit - it would be best to test this in your own environment. I doubt you will find a documented limit of a upload file size an AEM servlet can handle. 

 

 

Very interesting article. Thanks Scott for your reply. What about Package Manager. Do you think it scales better than Post Servlet or less.

smacdonald2008 wrote...

Here is an AEM article that talks about a tool that automates uploading files to AEM. Its basically a Java client that reads an XML file and then uploads to AEM. This was written a few years ago when people did not want to manually upload hundreds of pics to the AEM DAM. 

http://scottsdigitalcommunity.blogspot.ca/2013/10/automating-process-of-uploading-digital.html

Also - before package manager can be used - the files need to be in AEM. So this Java tool is a good way to get  a lot of assets into AEM. It also shows you to use AEM Asset Manager API. 

http://docs.adobe.com/docs/en/cq/5-6-1/javadoc/com/day/cq/dam/api/AssetManager.html

 

Thanks again. I have done it a few times in the past by following one of your great posts in your blog. I was trying to compare performance between the different options.