Upload a lot of Assets into DAM lead to AEM crash | Community
Skip to main content
Jacleng
Jacleng
Level 2
October 16, 2015
Solved

Upload a lot of Assets into DAM lead to AEM crash

  • October 16, 2015
  • 6 replies
  • 1339 views

Environment: AEM 6.0 + sp2 + hotfix-6167 + hotfix-5918 + hotfix-6109

I used AssetManager API to upload about 50thousand asset into AEM instance, it will crash soon(Total 400GB, upload about 30GB, then crash).

Does anyone have suggestion about this?

 

Thanks in advance!

Kelvin

This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.
Best answer by Pawan-Gupta

Hello,

It always adviced to upload DAM assets in batch because most of the time when you have upload assets and if some assets which you are uploading are big so usually it takes time to transfer over the net and sometime it leads to expire the session or break the communication (as per my experience)

Second, avoid bundling bigger files as part of upload instead upload them separately.

Thanks,

Pawan

6 replies

Pawan-Gupta
Pawan-GuptaAccepted solution
Level 8
October 16, 2015

Hello,

It always adviced to upload DAM assets in batch because most of the time when you have upload assets and if some assets which you are uploading are big so usually it takes time to transfer over the net and sometime it leads to expire the session or break the communication (as per my experience)

Second, avoid bundling bigger files as part of upload instead upload them separately.

Thanks,

Pawan

L
leeasling
Level 8
October 16, 2015

It's probably crashing because of the workflows that are running to create renditions and extract meta data.

I'd recommend taking a look at offloading the jobs:

http://docs.adobe.com/docs/en/aem/6-0/deploy/configuring/offloading.html#Offloading the Processing of DAM Assets
http://dev.day.com/content/ddc/en/gems/introduction-of-job-handling-and-offloading-in-aem-5-6-1-/_jcr_content/par/download_0/file.res/Offloading.pdf

smacdonald2008
smacdonald2008
Level 10
October 16, 2015

Open a ticket for this and determine if you have reached the limit of the AEM DAM or if a hotfix address this. 

Jacleng
JaclengAuthor
Level 2
October 16, 2015

Late to reply.

Thank you! :)

Jacleng
JaclengAuthor
Level 2
October 16, 2015

Hi,

The reference is pretty good, thanks a lot.

Offloading distributes processing tasks amoung instances, now I only have one instance, and need to upload all the assets into it. But I think that I can control the task start or not to make the server stable, but now have no time to validate it, I'll try it later.

best regards,

Kelvin

Jacleng
JaclengAuthor
Level 2
October 16, 2015

Hi Pawan,

 

I tried to upload the asset in batch, controlled the upload speed. it worked fine, 

thanks for your help,

best regards,

Kelvin

Terms & ConditionsAccessibility statement

Loading footer...