Disk Usage Report much smaller than disk space consumed

[michaelh2862615]

We have an AEM 6.2 instance with Hotfix 17578 (cq-6.2.0-hotfix-17578) installed so we are on Oak 1.4.17 and CFP18.

We run garbage collection, version cleanup, and workflow cleanup daily.  We have a separate datastore and segment store.  We have performed offline compaction but that only applies to the segmentstore.

The disk usage report in AEM (/etc/reports/diskusage.html) reports we are using ~18 GB of data.  However, our datastore has grown to ~170 GB of data.  I cannot find any way to figure out how to reduce this or where this is coming from.

From this page (Analyze unusual repository growth ) I can see we even have a few files between 1-6 GB but there is definitely no file in our DAM or packages that big.  The entire DAM according to the usage report is ~6 GB.

What can I do to reduce the size of our datastore?  What is causing this problem?

[michaelh2862615]

I am not sure what the best way to provide a report about the file differences.  I can tell you a quick summary comparing a difference in files between the old and new datastore:

diff -qrN datastore/ datastore-bak/ | wc -l

534635

The AEM Usage Report (/etc/reports/diskusage.html) is basically identical -- I do not have an exact comparison on numbers, but the difference is negligible for our purposes.

[Jörg_Hoh]

I would expect that the disk-usage report remains as is, because this report just iterates through the repository and sums up the size of the properties and binaries. It does not lookup files and such on the filesystem (thus does not know anything about segmentstore, datastores, shared datastores and such).

Just checking: Have you executed an offline compaction on your original instance before you ran the DSGC?

Jörg

[michaelh2862615]

Yes, I ran offline compaction multiple times and even tried removing all checkpoints at some point as recommended above.

[Jörg_Hoh]

Hm, very strange then.

Can you report this to Adobe support (if not done already), just to let them know about the situation you encountered and how you solved it?

thanks,

Jörg

[michaelh2862615]

Sure. I have just submitted a ticket.  Thanks for everyone's help.  I will update if Adobe comes back with anything insightful.