Publish Instance inaccessible during Bulk Publishing | Community
Skip to main content
aanchal-sikka
Community Advisor
Community Advisor
September 27, 2024
Solved

Publish Instance inaccessible during Bulk Publishing

  • September 27, 2024
  • 3 replies
  • 1587 views

Hello,

 

We are noticing slowness during Bulk Publishing. There are generally 100 assets at a time. Sometimes publish server is inaccessible and restores back once queue is cleared.

 

During publishing, we have 2 events 

  • Assets incoming from Author
  • Dispatcher Flush 

 

We have enabled Batch processing for Replication Agent, but no luck. Binaryless replication enabled.

 

Requesting suggestions on how we can improve this?

 

 

This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.
Best answer by joerghoh

please run a number of threaddumps (eg. 10 dumps with 1s delay between them) on publish during such a situation, that should allow you check details.

3 replies

EstebanBustamante
Community Advisor and Adobe Champion
Community Advisor and Adobe Champion
September 27, 2024

Hi, 

Is this happening on an On-premise instance, It is AMS? Are any useful info in the logs?

Esteban Bustamante
aanchal-sikka
Community Advisor
Community Advisor
September 28, 2024

@estebanbustamante 

 

This is an AMS instance. 

I have following improvements is mind, please let me know if they make sense and if there anything else we could do?

  • To use MCP based approach like Asynchronous publishing upto few assets then synchronous. 

 

ReplicationOptions options = new ReplicationOptions(); options.setSynchronous(true); replicatorService.replicate(session, ReplicationActionType.ACTIVATE, payloadPath, options);

 

  • Using TTLs & disabling dispatcher flush agent

 

Any thing you can think of that could help with optimizing resources?

Aanchal Sikka
EstebanBustamante
Community Advisor and Adobe Champion
Community Advisor and Adobe Champion
September 30, 2024

I think something is happening on the publisher's side. I would start by checking the JVM on the publishers, as Jorg has pointed out. You should take those dumps to see if anything is consuming memory.

Another thing I would check is indexing. Look for any unusual behavior around indexing with each activation. You should be able to see when the last indexing and re-indexing occurred and verify if everything is okay.

Esteban Bustamante
joerghoh
Adobe Employee
Adobe Employee
September 29, 2024

Where does the slowness happen? On author or on publish side? And when you mention "slowness", does it only affect the respective part of the replication (sending or receiving) or does it affect the entire instance and other activities as well?

aanchal-sikka
Community Advisor
Community Advisor
September 30, 2024

@joerghoh 

 

Thanks for the queries.

The slowness in observed on publish while accessing sites, performing search etc. Almost entire instance is slow. And it recovers in some time.

Aanchal Sikka
joerghoh
Adobe Employee
joerghohAdobe EmployeeAccepted solution
Adobe Employee
September 30, 2024

please run a number of threaddumps (eg. 10 dumps with 1s delay between them) on publish during such a situation, that should allow you check details.

arunpatidar
Community Advisor
Community Advisor
September 30, 2024

Hi @aanchal-sikka 
If you are using ACS Common the you can try Bulk Workflow Manager to replicate assets

https://adobe-consulting-services.github.io/acs-aem-commons/features/bulk-workflow-manager/index.html 

Arun Patidar
aanchal-sikka
Community Advisor
Community Advisor
September 30, 2024

@arunpatidar 

 

We have no control on when the data will flow to us. Many of which get published immediately. 

Aanchal Sikka
arunpatidar
Community Advisor
Community Advisor
September 30, 2024

Hi @aanchal-sikka 
Not sure if you can rely on sling job and executed only few immedialty with queue.maxparallel.

If you go with it then please considering created dedicated queue[1] and thread-pool[2]

 

[1] https://sling.apache.org/documentation/bundles/apache-sling-eventing-and-job-handling.html#queue-configurations 

[2] https://sling.apache.org/documentation/bundles/apache-sling-commons-thread-pool.html#create-a-new-thread-pool-1 

Arun Patidar