Rapid data*tar file growth

[Tom_Fought]

Hello Team.

Recently we had a publisher that started experienced rapid data*tar file file growth.

It just happened suddenly. Running with Java11.

Has anyone had this happen to them? and identified the root cause?

There is nothing in the logs that indicates why this happened.

Also, are there any tools that would allow inspecting the data*tar files with aem shutdown?

Thanks.

[Tom_Fought]

Need to add, the repository has valid consistency checki.

[narendiran_ravi]

Hi Tom,

I assume you are using AEM 6.5 version. Please follow below steps to identify the issue.

• Check if the revision cleanup task is running successfully. Refer to the Adobe documentation on monitoring online revision cleanup.

• Check your AEM publisher's thread dumps to identify any long-running threads that may increase the segment store size. Refer to the Adobe documentation on thread dump analysis.

• The segment store size may increase if there are frequent content updates. Verify if any recent bulk content has been activated to the publisher, such as a new site or product catalog data.

• If your publisher setup has multiple farms, check if the same segment store size issue is observed in other publishers.

[narendiran_ravi]

This is another article which you can check to debug your issue -https://experienceleague.adobe.com/en/docs/experience-cloud-kcs/kbarticles/ka-17496#aif-aem-is-runni... 

[Tethich]

Hi @Tom_Fought 

All the indications from @narendiran_ravi are very good and are first things to go to in such cases. In addition I would add that when I experienced such issues, for me it was because two things:

1. I had long running jobs that were continuously writing data. Maybe you have some custom integrations which pulls data in. You can check them in /var/eventing .
2. Sometimes assets processing for Dynamic Media was also rapidly increasing disk usage for me.

Maybe is not your case, but worth thinking about these two leads as well. Hope you can find your root cause and share it with us.