Servlet to iterate over several AEM pages and get html

Hi

You can write a custom OSGI component, which can read a JCR node value. So, same way you can read read HTML nodes.

Create custom components :- https://helpx.adobe.com/experience-manager/using/creating-custom-cq-component-uses.html

Reading JCR nodes, please have a look at any of these options:-

Link:- https://helpx.adobe.com/experience-manager/using/jqom.html

Link:- https://helpx.adobe.com/experience-manager/using/using-query-builder-api1.html (Query Builder)

Link:- https://helpx.adobe.com/experience-manager/using/querying-experience-manager-data-using1.html (JCR API)

I hope this would help you.

Thanks and Regards

Kautuk Sahni

@Sutty100,

I don't think we have any better way than Sing to get the HTML content on the page.. Even, Http would be hard because you need to perform authentication to execute any httpRequest from the backend.

-- Jitendra

I'm not sure that is exactly what I am after. To clarify I am creating a servlet that will create a JSON object that contains several AEM pages url and the HTML that would be rendered out on them, ideally I want to have just the html would be rendered out by components contained in a paragraph system. So an author has already created these pages and then somebody hits my servlet, it will iterate over all those pages in a specific directory and get the urls and the html that those pages would render out if they were hit directly.

That's a shame, I will have to look at doing this from the .jsp using sling.include which feels messy and I would rather do this from the backend! 

hi,
have you looked into using standard servlet request including?

request.getRequestDispatcher("/ConfirmationServlet").include(request, response);

You would have to create a ResponseWrapper which records all html output on that call rather than writing it to the actual response.

In your servlet, you can then get the html of each forward call and assemble the JSON. If you call the parsys resource directly, you should be able to get only the html you are interested in.

I have not done this with multiple forwards in one request, don't know if that can actually work.

hope that helps!

Hi Sutty,

As @scott and @kautuk mentioned, you can parse through the nodes using JCR API and get to the individual content/html at the parsys level or you can also use .json of the page and get all the content of the page and parse the json to get the html content.

However, what is your usecase for this ??

Thanks, my use case is for an E-commerce site. We will have a drop down menu and as you drill through the menu content will be shown in the menu. The category information comes from our E-commerce platform but for the content the plan is to allow content authors to manage that content in AEM eg create a page per category they want to customize and have a set of defaults to fall back to if they don't set up a customization. For performance what I wanted to do was on the first visit to the site to make a call to AEM to get a json representation of all of this content and then cache it in the users browser in the session storage. The javaScript is then responsible for parsing the json as the user clicks through the categories. The menu appears on both AEM pages and pages outside of AEM that are rendered by our E-commerce platform. The JSON might look like this: 

{
  "categories": [
    "category": {
      "id": "default",
      "content": "<p>hello</p><div><img src='bla'/></div>"
    },
    "category": {
    "id": "001",
    "content": "<p>Really cool content</p>"
    }
    "category": {
    "id": "002",
    "content": "<div>...maybe a video or something</div>"
    }
  ]
}