Your achievements

Level 1

0% to

Level 2

Tip /
Sign in

Sign in to Community

to gain points, level up, and earn exciting badges like the new
BedrockMission!

Learn More

View all

Sign in to view all badges

Repository growth reasons

Avatar

Avatar
Validate 10
Level 3
anilkum
Level 3

Likes

3 likes

Total Posts

65 posts

Correct Reply

1 solution
Top badges earned
Validate 10
Validate 1
Boost 3
Boost 1
Affirm 1
View profile

Avatar
Validate 10
Level 3
anilkum
Level 3

Likes

3 likes

Total Posts

65 posts

Correct Reply

1 solution
Top badges earned
Validate 10
Validate 1
Boost 3
Boost 1
Affirm 1
View profile
anilkum
Level 3

18-01-2017

Hi,

We are upgrading to AEM 6.1 from AEM 6.0. We have 1.5TB repository with default architecture on author. We had the experience of about 1 TB growth in every 2 days for which we sought help from Adobe support. We were recommended to change architecture (separate file datastore) to solve the growth issue. But surprisingly the growth stopped on its own with any changes.

Earlier we were struggling to explain the cause of growth and now we are struggling to explain why it stopped.

Any similar experiences?

Thanks,

Anil

Replies

Avatar

Avatar
Validate 25
Level 10
smacdonald2008
Level 10

Likes

1,409 likes

Total Posts

12,671 posts

Correct Reply

2,278 solutions
Top badges earned
Validate 25
Validate 10
Validate 1
Give back 900
Give back 600
View profile

Avatar
Validate 25
Level 10
smacdonald2008
Level 10

Likes

1,409 likes

Total Posts

12,671 posts

Correct Reply

2,278 solutions
Top badges earned
Validate 25
Validate 10
Validate 1
Give back 900
Give back 600
View profile
smacdonald2008
Level 10

18-01-2017

repgrowth.log will help to find the cause. More details at  https://helpx.adobe.com/experience-manager/kb/analyze-unusual-repository-growth.html 

Hope this helps. 

Avatar

Avatar
Validate 10
Level 3
anilkum
Level 3

Likes

3 likes

Total Posts

65 posts

Correct Reply

1 solution
Top badges earned
Validate 10
Validate 1
Boost 3
Boost 1
Affirm 1
View profile

Avatar
Validate 10
Level 3
anilkum
Level 3

Likes

3 likes

Total Posts

65 posts

Correct Reply

1 solution
Top badges earned
Validate 10
Validate 1
Boost 3
Boost 1
Affirm 1
View profile
anilkum
Level 3

18-01-2017

Hi Donald,

I have tried this but I couldn't get much information.  Since the growth has stopped I am not sure I can generate this file again.

Regards,

Anil

Avatar

Avatar
Give Back 10
Level 2
huzaifaha985211
Level 2

Likes

0 likes

Total Posts

25 posts

Correct Reply

5 solutions
Top badges earned
Give Back 10
Give Back 5
Give Back 3
Give Back
Affirm 5
View profile

Avatar
Give Back 10
Level 2
huzaifaha985211
Level 2

Likes

0 likes

Total Posts

25 posts

Correct Reply

5 solutions
Top badges earned
Give Back 10
Give Back 5
Give Back 3
Give Back
Affirm 5
View profile
huzaifaha985211
Level 2

18-01-2017

If you guys have done any UI customization on 6.0, they may not work when you decide to migrate over from 6.1 to 6.2 in future. Just something to be aware of. There could be many reasons why a repository growth happens exponentially overnight. Are there any backend scripts/processes running that interacts with the repository? Have you tried putting in compaction script in place "In 6.2 it's called Revision cleanup"? Have you placed any monitoring on the drives to see what is the peak time when the size growth happens? Were there any hotfixes/bundles recently deployed?

These should point you to the right direction.

Avatar

Avatar
Boost 3
Level 2
Jit_S_
Level 2

Likes

3 likes

Total Posts

15 posts

Correct Reply

0 solutions
Top badges earned
Boost 3
Give Back 3
Give Back
Ignite 1
Validate 1
View profile

Avatar
Boost 3
Level 2
Jit_S_
Level 2

Likes

3 likes

Total Posts

15 posts

Correct Reply

0 solutions
Top badges earned
Boost 3
Give Back 3
Give Back
Ignite 1
Validate 1
View profile
Jit_S_
Level 2

18-01-2017

What patch level were you on in 6.0? Please note that there was an issue that was fixed awhile back: http://help-forums.adobe.com/content/adobeforums/en/experience-manager-forum/adobe-experience-manage...

Avatar

Avatar
Validate 10
Level 3
anilkum
Level 3

Likes

3 likes

Total Posts

65 posts

Correct Reply

1 solution
Top badges earned
Validate 10
Validate 1
Boost 3
Boost 1
Affirm 1
View profile

Avatar
Validate 10
Level 3
anilkum
Level 3

Likes

3 likes

Total Posts

65 posts

Correct Reply

1 solution
Top badges earned
Validate 10
Validate 1
Boost 3
Boost 1
Affirm 1
View profile
anilkum
Level 3

18-01-2017

~~I will answer pointwise


1) Are there any backend scripts/processes running that interacts with the repository?

None that we are aware of. We have inherited this project with limited KT.


2) Have you tried putting in compaction script in place?

Originally the repo was 3 TB, Tar compaction bought it down to 1.5 after which it was upgraded to AEM 6.1 SP1. After upgrade, it was stable initially then online compaction started firing but after sometime we got a disk space outage when we realized the issue. We restored from a previously available backup. Compacted it from 5 TB back to 1.5 TB but issue restarted. Suddenly more than a week back it stopped growing on its own and repo is at 1.5 TB only.

3) Have you placed any monitoring on the drives to see what is the peak time when the size growth happens?

No but I monitored it and it was fairly consistent irrespective whether it was night or day

4) Were there any hotfixes/bundles recently deployed?

No. We only installed content packages in GB size through the install folder method. We didn't remove the packages after it installed BUT when we removed the package it still dint solve the growth issue. We did a lucene full index for some search related issue. Nothing more than this.

@Jit S, we are upgrading to 6.1 for more stability and this issue has caused a lot of concern. First because it was happen and now because it is not happening without a proper explanation.

Thanks,

Anil

Avatar

Avatar
Give Back 10
Level 2
huzaifaha985211
Level 2

Likes

0 likes

Total Posts

25 posts

Correct Reply

5 solutions
Top badges earned
Give Back 10
Give Back 5
Give Back 3
Give Back
Affirm 5
View profile

Avatar
Give Back 10
Level 2
huzaifaha985211
Level 2

Likes

0 likes

Total Posts

25 posts

Correct Reply

5 solutions
Top badges earned
Give Back 10
Give Back 5
Give Back 3
Give Back
Affirm 5
View profile
huzaifaha985211
Level 2

18-01-2017

were there any irregularities in the error.log? for example exceptions getting printed thousand times etc?

Avatar

Avatar
Level 1
surya_raju
Level 1

Likes

0 likes

Total Posts

5 posts

Correct Reply

0 solutions
View profile

Avatar
Level 1
surya_raju
Level 1

Likes

0 likes

Total Posts

5 posts

Correct Reply

0 solutions
View profile
surya_raju
Level 1

24-09-2017

Hi Anil,

It may be late but wanted to know if you have found the root cause or not.

did any  DAM uploads happened on AEM after its migration to 6.1?

Regards

Surya