Expand my Community achievements bar.

Use Azure Blob storage to store DAM Assets and access from AEM

Avatar

Level 4

HI,

 

We are in AEM 6.5.5 and need to use Azure Blob storage to store some of our heavy assets (videos mostly) and then reference it from DAM so that we can use features of DAM like security/permissions etc. We were following this article - https://experienceleague.adobe.com/docs/experience-manager-65/deploying/deploying/data-store-config....

 

Also this solution we need for one of our sites residing in same AEM instance, but not for all.

I have gone through this video and tried to implement as described - https://www.youtube.com/watch?v=wAjy9MyP6Sg

 

But I do not see folders inside repository or dont see Azure container is created. My local instance itself not running now. Although there is no error in logs.

 

This is from my Terminal:

Last login: Tue Nov 24 11:37:15 on ttys000

macC02TG0VXH03Q:~ mukmayu$ ps -ef | grep java

  264   106     1   0 Wed06pm ??         1:30.61 ../jre/bin/java -classpath /Library/Hive/application/PeerTvMonitor.jar com.peerialism.watchdog.PeerTvMonitor

  264   276   106   0 Wed06pm ??         7:10.99 /Library/Hive/jre/bin/java -Xss3m -jar PeerTVClient.jar --consoleloglevel ERROR --noninteractive true --dir /Library/Hive/application/.

755158944  1644  1340   0 Wed06pm ??         3:46.56 /Library/Java/JavaVirtualMachines/jdk1.8.0_271.jdk/Contents/Home/bin/java -jar /Users/mukmayu/.vscode/extensions/sonarsource.sonarlint-vscode-1.18.0/server/sonarlint-ls.jar 49390 file:///Users/mukmayu/.vscode/extensions/sonarsource.sonarlint-vscode-1.18.0/analyzers/sonarjava.jar file:///Users/mukmayu/.vscode/extensions/sonarsource.sonarlint-vscode-1.18.0/analyzers/sonarjs.jar file:///Users/mukmayu/.vscode/extensions/sonarsource.sonarlint-vscode-1.18.0/analyzers/sonarphp.jar file:///Users/mukmayu/.vscode/extensions/sonarsource.sonarlint-vscode-1.18.0/analyzers/sonarpython.jar file:///Users/mukmayu/.vscode/extensions/sonarsource.sonarlint-vscode-1.18.0/analyzers/sonarhtml.jar

755158944  1716  1430   0 Wed06pm ??       139:31.89 ./jre/bin/java -XX:+UseG1GC -XX:-ShrinkHeapInSteps -XX:InitiatingHeapOccupancyPercent=10 -Xmx128M -XX:+UseStringDeduplication -XX:+UnlockDiagnosticVMOptions -XX:NewSize=32M -XX:MaxNewSize=32M -XX:CompressedClassSpaceSize=32M -XX:MaxMetaspaceSize=96M -XX:MaxDirectMemorySize=32M -XX:ReservedCodeCacheSize=16M -Xss1M -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=logs/ -XX:ErrorFile=logs/mac-agent.out.0 -Xlog:gc=debug:file=logs/mac-agent-gc.log:uptimemillis,pid:filecount=2,filesize=2m -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=logs/ -Dhttps.protocols=TLSv1,TLSv1.1,TLSv1.2,TLS1.3 -cp lib/aopalliance-1.0.jar:lib/bcprov-jdk15-1.46.jar:lib/commons-codec-1.9.jar:lib/commons-collections-3.2.1.jar:lib/commons-collections4-4.1.jar:lib/commons-httpclient-3.1.jar:lib/commons-io-2.5.jar:lib/commons-lang-2.6.jar:lib/commons-logging-1.2.jar:lib/commons-net-3.3.jar:lib/da.jar:lib/esapi-2.0.1.jar:lib/groovy-2.5.1.jar:lib/guava-19.0.jar:lib/hibernate-jpa-2.1-api-1.0.0.Final.jar:lib/httpasyncclient-4.1.2.jar:lib/httpclient-4.5.2.jar:lib/httpcore-4.4.4.jar:lib/httpcore-nio-4.4.5.jar:lib/httpmime-4.5.2.jar:lib/jackson-annotations-2.7.0.jar:lib/jackson-core-2.7.4.jar:lib/jackson-databind-2.7.4.jar:lib/jackson-dataformat-xml-2.7.4.jar:lib/jackson-module-jaxb-annotations-2.7.4.jar:lib/jna-4.3.0.jar:lib/jnr-ffi.jar:lib/joda-time-2.2.jar:lib/junit-3.8.1.jar:lib/log4j-1.2.17.jar:lib/mac-agent-2.0-SNAPSHOT.jar:lib/not-yet-commons-ssl-0.3.9.jar:lib/opensaml-2.6.1.jar:lib/openws-1.5.1.jar:lib/serializer-2.7.1.jar:lib/slf4j-api-1.5.8.jar:lib/slf4j-jdk14-1.5.6.jar:lib/spring-aop-3.2.18.RELEASE.jar:lib/spring-beans-3.2.18.RELEASE.jar:lib/spring-context-3.2.18.RELEASE.jar:lib/spring-core-4.1.9.RELEASE.jar:lib/spring-expression-3.2.18.RELEASE.jar:lib/spring-security-config-3.1.2.RELEASE.jar:lib/spring-security-core-3.2.10.RELEASE.jar:lib/spring-security-saml2-core-1.0.2.RELEASE.jar:lib/spring-security-web-3.2.10.RELEASE.jar:lib/spring-web-3.2.18.RELEASE.jar:lib/sqlite-jdbc-3.8.11.2-102.jar:lib/stax2-api-3.1.4.jar:lib/velocity-1.7.jar:lib/xalan-2.7.1.jar:lib/xercesImpl-2.10.0.jar:lib/xml-apis-1.4.01.jar:lib/xml-resolver-1.2.jar:lib/xmlsec-1.5.6.jar:lib/xmltooling-1.4.1.jar -Djdk.attach.allowAttachSelf=true -Djavax.net.ssl.trustStore=config/trustedcerts -Djava.util.logging.config.file=config/logging.properties com.aternity.mac_agent.AgentCore

755158944 68178 68177   0 10:13am ??        15:35.30 /Library/Internet Plug-Ins/JavaAppletPlugin.plugin/Contents/Home/bin/java -jar /Users/mukmayu/All_Documents/AEM4Azure/AEM6.5/Azure/Author/cq-quickstart-6.5.0-standalone-quickstart.jar

755158944 85483     1   0 11:56am ??         6:17.76 /usr/bin/java -jar AEM_6.5_Quickstart.jar -r crx3tar-nofds

755158944 86383 86372   0 12:01pm ttys000    0:00.00 grep java

macC02TG0VXH03Q:~ mukmayu$ kill -9 755158944

-bash: kill: (755158944) - No such process

macC02TG0VXH03Q:~ mukmayu$ cd All_Documents/

macC02TG0VXH03Q:All_Documents mukmayu$ cd AEM4Azure/

macC02TG0VXH03Q:AEM4Azure mukmayu$ ls

AEM6.5

macC02TG0VXH03Q:AEM4Azure mukmayu$ cd AEM6.5/

macC02TG0VXH03Q:AEM6.5 mukmayu$ ld

ld: warning: No version-min specified on command line

ld: no object files specified

macC02TG0VXH03Q:AEM6.5 mukmayu$ ls

Azure

macC02TG0VXH03Q:AEM6.5 mukmayu$ cdA

-bash: cdA: command not found

macC02TG0VXH03Q:AEM6.5 mukmayu$ ls

Azure

macC02TG0VXH03Q:AEM6.5 mukmayu$ cd Azure/

macC02TG0VXH03Q:Azure mukmayu$ ls

Author

macC02TG0VXH03Q:Azure mukmayu$ cd Author/

macC02TG0VXH03Q:Author mukmayu$ ls

AEM_6.5_Quickstart.jar license.properties sling uber-jar-6.5.0-apis.jar

macC02TG0VXH03Q:Author mukmayu$ java -jar AEM_6.5_Quickstart.jar -unpack

Loading quickstart properties: default

Loading quickstart properties: instance

Setting properties from filename '/Users/mukmayu/All_Documents/AEM4Azure/AEM6.5/Azure/Author/AEM_6.5_Quickstart.jar'

Verbose mode - stdout/err not redirected to files, and stdin not closedResourceProvider paths=[/gui, /gui/default]

quickstart.build=0.0.0.0_0_0_6_5_.20190328

quickstart.properties not found, initial install

UpgradeUtil.handleInstallAndUpgrade has mode INSTALL

Saving build number in quickstart.properties

Upgrade: no files to restore from pre-upgrade backup

31 files extracted from jar file

Running chmod +x /Users/mukmayu/All_Documents/AEM4Azure/AEM6.5/Azure/Author/crx-quickstart/bin/start

Running chmod +x /Users/mukmayu/All_Documents/AEM4Azure/AEM6.5/Azure/Author/crx-quickstart/bin/stop

Running chmod +x /Users/mukmayu/All_Documents/AEM4Azure/AEM6.5/Azure/Author/crx-quickstart/bin/status

Running chmod +x /Users/mukmayu/All_Documents/AEM4Azure/AEM6.5/Azure/Author/crx-quickstart/bin/quickstart

Not starting the Quickstart server as the -unpack option is set

Quickstart files unpacked, server startup scripts can be found under /Users/mukmayu/All_Documents/AEM4Azure/AEM6.5/Azure/Author/crx-quickstart/bin

 

Can someone point out where I am going wrong or is it possible to implement for one folder in DAM. In our case single AEM instance hosts multiple sites and we dont want all of them in Azure.

6 Replies

Avatar

Level 4

Hi Bhuwan, I tried to run the commands to check the connection as mentioned in the post, but getting below error:

 

macC02TG0VXH03Q:Documents mukmayu$ java -jar /Users/mukmayu/Documents/oak-run-1.6.6.jar console /Users/mukmayu/All_Documents/AEM4Azure/AEM6.5/Azure/Author/crx-quickstart/repository/segmentstore --azureds=/Users/mukmayu/All_Documents/AEM4Azure/AEM6.5/Azure/Author/crx-quickstart/install/org.apache.jackrabbit.oak.plugins.blob.datastore.AzureDataStore.config

Apache Jackrabbit Oak 1.6.6

Exception in thread "main" joptsimple.UnrecognizedOptionException: 'azureds' is not a recognized option

at joptsimple.OptionException.unrecognizedOption(OptionException.java:89)

at joptsimple.OptionParser.handleLongOptionToken(OptionParser.java:429)

at joptsimple.OptionParserState$2.handleArgument(OptionParserState.java:56)

at joptsimple.OptionParser.parse(OptionParser.java:361)

at org.apache.jackrabbit.oak.console.Console.main(Console.java:68)

at org.apache.jackrabbit.oak.run.ConsoleCommand.execute(ConsoleCommand.java:26)

at org.apache.jackrabbit.oak.run.Mode.execute(Mode.java:65)

at org.apache.jackrabbit.oak.run.Main.main(Main.java:49)

macC02TG0VXH03Q:Documents mukmayu$

Avatar

Level 4
So I found the issue, it was due to SSL cert. So i added the Azure cert in keystore and I no longer see the error in error.log and my local is up now. But there is nothing in Azure as well...I dont see my DAM asset or the new container I added...Am I missing something ..?

Avatar

Level 4
I still see issue, although my local instance is up now and I no longer see any error..But I dont see any asset getting pushed to Azure as well...debugging it now.