Large number of Asset Data store | Community
Skip to main content
brijesht1767899
brijesht1767899
Level 2
December 22, 2017
Solved

Large number of Asset Data store

  • December 22, 2017
  • 4 replies
  • 3746 views

Hi All,

In our project we have to manage large number of Assets so which Datastore is best to go with.

1: Mongo Datastore

2: File Data store

3: Amazon S3 Datastore

Any suggestion would be of great help. Thanks in Advance

    This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.
    Best answer by joerghoh

    Hi,

    First you should rule out the Mongo Datastore. Loading large binaries into Mongo doesn't perform very well and is neither recommended by Mongo nor by Adobe.

    I would prefer S3 datastore but only if you are hosting at AWS.  The hardest choice is on-prem hosting, because there S3 can be not attractive due to high network latency or for policy reasons. In that case I would validate the setup first by doing a proof of concept and running performance tests of an S3-based setup vs a FileDataStore-setup.

    Remember: In the FDS you need to care about backup and restore yourself. And this can be problematic if you deal with tens of terabytes of data and a lot of files.

    Jörg

    4 replies

    manoj_devapath
    manoj_devapath
    Level 5
    December 22, 2017

    You can use either Mongo Datastore or Amazon S3 Datastore. It depends on DAM size and useable scalability of DAM

    We have done POC for Amazon S3 Datastore one of our clients.

    Amazon S3 Datastore connectors are avialable for 6.2 1.4x feature pack versions com.adobe.granite.oak.s3connector-1.4.x.zip

    You can achive this with simple configs on segment store, nodestore ,datastore , aws service and S3 Bucket.

    Here is very good doc for DataStore

    Configuring node stores and data stores in AEM 6

    joerghoh
    Adobe Employee
    joerghohAdobe EmployeeAccepted solution
    Adobe Employee
    December 22, 2017

    Hi,

    First you should rule out the Mongo Datastore. Loading large binaries into Mongo doesn't perform very well and is neither recommended by Mongo nor by Adobe.

    I would prefer S3 datastore but only if you are hosting at AWS.  The hardest choice is on-prem hosting, because there S3 can be not attractive due to high network latency or for policy reasons. In that case I would validate the setup first by doing a proof of concept and running performance tests of an S3-based setup vs a FileDataStore-setup.

    Remember: In the FDS you need to care about backup and restore yourself. And this can be problematic if you deal with tens of terabytes of data and a lot of files.

    Jörg

      brijesht1767899
      brijesht1767899Author
      Level 2
      December 23, 2017

      Hi Jorg,

      Thanks for your valuable input.

      brijesht1767899
      brijesht1767899Author
      Level 2
      December 23, 2017

      Hi Member,

      Thanks for your valuable input and document.

      Terms & ConditionsAccessibility statement

      Loading footer...