Using SCD for user data which is registering on live sites. We have 2 publishers and sync data is working . But if we see crx/package manager , we can able to see 40000 packages under sling folder in package manager console.
As per my knowledge , if data got synced it needs to remove from author as well. Not sure, how to proceed further.
2 weeks ago i saw some 32k nodes and deleted from /var/sling/jobs and again we got the same issue, Please advice if we need to configure any scheduler to delete for some specific time
As per my understanding if pub1 needs to sync with pub 2 data , then it will be created as package and will be moved to author and then from author it will moved to another pubisher.
Like that sling folder in crx/package manager contains 40k packages and even package manager console is not openning due to heavy data .
But if i add user in pub1 it is getting automatically synced with pub 2 without issue. Not sure then why this sling data is present (it should automatically delete from author if sync activity completes)
Seems your user sync is not working? Ideally these packages should get deleted.
What version of AEM? What Hotfixes you have installed? Do you have FP5 of communities?
Also, please install SP2 if on AEM 6.1 version.
For now, i suggest
Clean /var/eventing/jobs to tmp (delete recursively if needed)
Clean /var/eventing/distribution to tmp (delete recursively if needed)
Clean /var/sling/distribution/packages to temp (delete recursively if needed)
Clean /etc/packages/sling/distribution to tmp (delete recursively if needed)
Clean /var/community/distribution to tmp (delete recursively if needed)
Restart event support bundle and distribution core bundle
If issue persists, please file a daycare for more investigation.
Package gets auto deleted from author.
In case, it is not getting Deleted from /var/* folders then it may be it is not getting synced across publishers.
Only, the above scenario is the option due to which folders under /var/* are not getting deleted.
Please try to debug the cause of data sync.