Your achievements

Level 1

0% to

Level 2

Tip /
Sign in

Sign in to Community

to gain points, level up, and earn exciting badges like the new
BedrockMission!

Learn More

View all

Sign in to view all badges

Memory Consumption is too high by AEM pid

Avatar

Avatar
Validate 1
Level 2
hardik11071994
Level 2

Like

1 like

Total Posts

41 posts

Correct Reply

0 solutions
Top badges earned
Validate 1
Give Back 5
Give Back 3
Give Back
Ignite 3
View profile

Avatar
Validate 1
Level 2
hardik11071994
Level 2

Like

1 like

Total Posts

41 posts

Correct Reply

0 solutions
Top badges earned
Validate 1
Give Back 5
Give Back 3
Give Back
Ignite 3
View profile
hardik11071994
Level 2

28-05-2018

Hi Team,

On our production environment we have two publish instance. Site is load balance by dispatcher on both publish.

16 GB Memory available on both server but most of the time memory consumption high  and due to that the server hung.

Mem:  16335344k total, 14835632k used,  1499712k free,  3486092k buffers

Swap:  4194300k total,   111016k used,  4083284k free,  4851876k cached

Also in logs I can see the below error which i think seems problematic.

28.05.2018 01:12:05.738 *ERROR* [Process Executor for diskusage.sh] com.adobe.granite.monitoring.impl.ShellScriptExecutorImpl Error while executing script /data/apps/aem/publish/crx-quickstart/monitoring/diskusage.sh

similar for cpu.sh

Could you please help us to provide the ways to free up the memory ? Do i have to do any changes in configurations?

Replies

Avatar

Avatar
Validate 25
Level 10
smacdonald2008
Level 10

Likes

1,406 likes

Total Posts

12,671 posts

Correct Reply

2,278 solutions
Top badges earned
Validate 25
Validate 10
Validate 1
Give back 900
Give back 600
View profile

Avatar
Validate 25
Level 10
smacdonald2008
Level 10

Likes

1,406 likes

Total Posts

12,671 posts

Correct Reply

2,278 solutions
Top badges earned
Validate 25
Validate 10
Validate 1
Give back 900
Give back 600
View profile
smacdonald2008
Level 10

28-05-2018

See this performance doc topic -- Performance tuning tips | 6.x

Avatar

Avatar
Give Back 50
Employee
Kunwar
Employee

Likes

65 likes

Total Posts

253 posts

Correct Reply

72 solutions
Top badges earned
Give Back 50
Give Back 5
Give Back 3
Give Back 25
Give Back 10
View profile

Avatar
Give Back 50
Employee
Kunwar
Employee

Likes

65 likes

Total Posts

253 posts

Correct Reply

72 solutions
Top badges earned
Give Back 50
Give Back 5
Give Back 3
Give Back 25
Give Back 10
View profile
Kunwar
Employee

28-05-2018

These won't create high memory consumption. I would suggest to generate a heap dump at the time of this situation and analyze it using MAT or any similar to identify the root cause.

Avatar

Avatar
Coach
Employee
Jörg_Hoh
Employee

Likes

1,086 likes

Total Posts

3,121 posts

Correct Reply

1,063 solutions
Top badges earned
Coach
Give back 600
Ignite 5
Ignite 3
Ignite 1
View profile

Avatar
Coach
Employee
Jörg_Hoh
Employee

Likes

1,086 likes

Total Posts

3,121 posts

Correct Reply

1,063 solutions
Top badges earned
Coach
Give back 600
Ignite 5
Ignite 3
Ignite 1
View profile
Jörg_Hoh
Employee

28-05-2018

The numbers you posted are not something to worry about in the first place. You should start a structured process to asses the root cause of the performance problem.

Jörg

Avatar

Avatar
Validate 1
Level 2
hardik11071994
Level 2

Like

1 like

Total Posts

41 posts

Correct Reply

0 solutions
Top badges earned
Validate 1
Give Back 5
Give Back 3
Give Back
Ignite 3
View profile

Avatar
Validate 1
Level 2
hardik11071994
Level 2

Like

1 like

Total Posts

41 posts

Correct Reply

0 solutions
Top badges earned
Validate 1
Give Back 5
Give Back 3
Give Back
Ignite 3
View profile
hardik11071994
Level 2

30-05-2018

Yes Jorg ,

Sometimes it consume full 16 GB memory and due to that server went into hung state.

Mem:  16335344k total, 16127708k used,   207636k free,  2456296k buffers

Swap:  4194300k total,   152456k used,  4041844k free,  4437592k cached

Sure I will start the structured process to find root cause as mentioned by kunwar and Mac.

Avatar

Avatar
Validate 1
Level 2
hardik11071994
Level 2

Like

1 like

Total Posts

41 posts

Correct Reply

0 solutions
Top badges earned
Validate 1
Give Back 5
Give Back 3
Give Back
Ignite 3
View profile

Avatar
Validate 1
Level 2
hardik11071994
Level 2

Like

1 like

Total Posts

41 posts

Correct Reply

0 solutions
Top badges earned
Validate 1
Give Back 5
Give Back 3
Give Back
Ignite 3
View profile
hardik11071994
Level 2

30-05-2018

Thank you for the link.

One question from the link :

Tuning Sling Job Queues : The maximum number of parallel jobs started for this queue. - As per the documentation we should set the queue.maxparallel  value  50% of CPU cores.

so we have 8 core CPU - so it should be 4 right. But we have 15 defined in configuration on environment.

Do I have to change it to 4 ? please guide. Thank you.

Avatar

Avatar
Validate 25
MVP
PuzanovsP
MVP

Likes

135 likes

Total Posts

541 posts

Correct Reply

164 solutions
Top badges earned
Validate 25
Validate 10
Validate 1
Contributor 2
Ignite 10
View profile

Avatar
Validate 25
MVP
PuzanovsP
MVP

Likes

135 likes

Total Posts

541 posts

Correct Reply

164 solutions
Top badges earned
Validate 25
Validate 10
Validate 1
Contributor 2
Ignite 10
View profile
PuzanovsP
MVP

31-05-2018

Hi Hardik,

16GB is huge amount of data to allocate to your publisher already.

Have you taken memory dump and analysed what is consuming your memory?

Regards,

Peter

Avatar

Avatar
Coach
Employee
Jörg_Hoh
Employee

Likes

1,086 likes

Total Posts

3,121 posts

Correct Reply

1,063 solutions
Top badges earned
Coach
Give back 600
Ignite 5
Ignite 3
Ignite 1
View profile

Avatar
Coach
Employee
Jörg_Hoh
Employee

Likes

1,086 likes

Total Posts

3,121 posts

Correct Reply

1,063 solutions
Top badges earned
Coach
Give back 600
Ignite 5
Ignite 3
Ignite 1
View profile
Jörg_Hoh
Employee

31-05-2018

Before you change anything, you should start into a rigorous analysis phase:

* Are you absolutely sure that the AEM instance is the root cause of the problem? Have you eliminated webservers, networks, loadbalancers and the client systems as candidates for the problem you see? At the moment I don't see a causal relation between "the memory usage is high" (the data you showed are signs of a busy system, but not indicating problems per se) and "the server is hung".

* What does "the server is hung" mean? Can you prove that with logs? request.log? garbage collection logs?

* How often does this happen? Does it correlate with other external events?

Please, before you change anything, make sure that you actually understand the problem.

Jög