clearing and refetching bulk content | Community
Skip to main content
Adilmo
Adilmo
Level 4
March 31, 2021
Solved

clearing and refetching bulk content

  • March 31, 2021
  • 3 replies
  • 2569 views

We need to bulk publish content (10000s of pages).  They are created as a scheduled event so require almost immediate publish for all the pages in one go.  Main challenge is how to invalidate content on dispatcher (10000s of pages) and then re-fetch these pages again (on multiple dispatchers). 

 

What is the best strategy to do this ?? Is there a possibility of leveraging network storage for dispatcher cache??

 

 

This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.
Best answer by joerghoh

 

Regarding the refetching: have you already checked https://medium.com/tech-learnings/how-to-use-re-fetching-flush-agent-in-adobe-experience-manager-aem-118cb7767305?

3 replies

Asutosh_Jena_
Community Advisor
Asutosh_Jena_Community Advisor
Community Advisor
March 31, 2021

Hi @adilmo 

You can issue an HTTP request that causes the dispatcher to delete cached files, and immediately retrieve and recache the file.

Delete and immediately re-cache files when web sites are likely to receive simultaneous client requests for the same page. Immediate recaching ensures that Dispatcher retrieves and caches the page only once, instead of once for each of the simultaneous client requests.

 

POST /dispatcher/invalidate.cache HTTP/1.1
CQ-Action: Activate
Content-Type: text/plain
CQ-Handle: /content/something/en_us/123.html
Content-Length: 12

/content/something/en_us/123.html

 

Also, you can write a flush-cache servlet which can send an invalidate request to Dispatcher and can recache the content. Please take necessary precautions while implementing the flush-cache servlet. Please see the link below for more details:

https://experienceleague.adobe.com/docs/experience-manager-dispatcher/using/configuring/page-invalidate.html?lang=en#manually-invalidating-the-dispatcher-cache

 

Hope this helps!

Thanks!

 

    Adilmo
    AdilmoAuthor
    Level 4
    March 31, 2021
    I Know that but my question is more on how to manage clearing and refetching of 1000s of pages on multiple dispatchers
    joerghoh
    Adobe Employee
    joerghohAdobe EmployeeAccepted solution
    Adobe Employee
    April 1, 2021

     

    Regarding the refetching: have you already checked https://medium.com/tech-learnings/how-to-use-re-fetching-flush-agent-in-adobe-experience-manager-aem-118cb7767305?

      Adilmo
      AdilmoAuthor
      Level 4
      April 6, 2021
      yes
      Umesh_Thakur
      Community Advisor
      Umesh_ThakurCommunity Advisor
      Community Advisor
      April 5, 2021

      As @joerghoh  mentioned, you can go with the re-fetching flush agent for this purpose with some modification. If number of pages are 10k then refetching al those 10k pages will flood your publisher with request from dispatcher and again will be a performance issue for you so it will be better to re-fetch only very frequent page out of those 10k like homepage and all and cache all other pages on user request. With the help of java you can use path URL to allow re-fetching.

      Hope this will help.

      Umesh Thakur

        Terms & ConditionsAccessibility statement

        Loading footer...