S3 bucket size drastically increasing (daily 300GB) | Community
Skip to main content
Unnikrishnankv
Unnikrishnankv
Level 3
March 2, 2018

S3 bucket size drastically increasing (daily 300GB)

  • March 2, 2018
  • 6 replies
  • 8143 views

Dear Team,

We are using S3 bucket to  save DAM data which have more than 5 KB. Daily we are creating 1000 pages and 200 images (max size of image is 80 kb). But S3 is increasing via 300 GB daily. Please help to find the reason behind this

Thanks!,

Devakrishna

This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.

6 replies

smacdonald2008
smacdonald2008
Level 10
March 2, 2018

Checking with our internal team.

Unnikrishnankv
UnnikrishnankvAuthor
Level 3
March 5, 2018

if  I configured s3 in my server.. what are the files uploaded  to s3 ?

smacdonald2008
smacdonald2008
Level 10
March 5, 2018

If you do not hear from any community member on this - you should consider opening a ticket.

VeenaVikraman
Community Advisor
VeenaVikramanCommunity Advisor
Community Advisor
March 5, 2018

Did you check with AWS customer support. This looks more like an issue in AWS than AEM?

navinkaushal
navinkaushal
Level 4
March 5, 2018

Hi Deva,

Please check if you have multiple renditions automated workflows or the bulk image uploads being done by AEM userS?

Unnikrishnankv
UnnikrishnankvAuthor
Level 3
March 6, 2018

We have enabled renditions automated workflow, actually that is default workflow. We are tried to disable that workflow but it does not disabled , is there any option to disable??

navinkaushal
navinkaushal
Level 4
March 6, 2018

You can achieve this by disabling existing launcher of dam "Update Assest Workflow".
Open http://localhost:4502/libs/cq/workflow/content/console.html  -- go to -> Launcher Tab and search for DAM Update assest.

Edit configuration and select Disable and then click OK. Please see the image below:

Unnikrishnankv
UnnikrishnankvAuthor
Level 3
March 27, 2018

Dear All,

Please find my analysis on this.

I have tired in Vanilla Instance

=======================

1) Rendition issue  - If i add one image in dam it will create 4 image rendition in dam- our image have maximum size is 80 KB

     Maximum image per day is 500 --  We Have disabled above workflow , no big change  growth size

2) Replication -- Root cause of issue.

=============================

  I have created one article  it have size is one 1 MB  if replicate to publishers it create one reference in  S3  i t have size is 1 MB

if i have 2 publisher then it create 2 entries in S3 and total size is 2MB, Our environment have more than 30 publishers  and minimum page is 3MB,

Our Total Article creation per day is 1500

Our image upload to dam is 500

Average replication is 2000

How i can fix this issue ???

Unnikrishnankv
UnnikrishnankvAuthor
Level 3
March 29, 2018

Adobe Scout

Terms & ConditionsAccessibility statement

Loading footer...