Expand my Community achievements bar.

Adobe Cluster Locking issues

Avatar

Level 1

We have two nodes in the cluster. Adobe is installed on just one node. Locator is running on one node. Experiencing locking issues for temporary diskstore. Below is the error description.

[12/10/14 13:13:44:925 EST] 00000013 webapp    I com.ibm.ws.webcontainer.webapp.WebGroupImpl WebGroup SRVE0169I: Loading Web Module: dsc.war.

[12/10/14 13:13:44:935 EST] 00000013 WASSessionCor I SessionContextRegistry getSessionContext SESN0176I: Will create a new session context for application key default_host/dsc

[12/10/14 13:13:44:963 EST] 00000013 ServletWrappe I com.ibm.ws.webcontainer.servlet.ServletWrapper init SRVE0242I: [LiveCycleES4] [/dsc] [UploadServlet]: Initialization successful.

[12/10/14 13:13:44:970 EST] 00000013 ArchiveFileMa A   ArchiveFileManagerImpl:getLocalCacheRootDir():Adobe tmp directory is:/data/exigen_test/PT/jvm/tmp/adobews__-581654660

[12/10/14 13:14:17:041 EST] 00000013 LocalExceptio E   CNTR0020E: EJB threw an unexpected (non-declared) exception during invocation of method "getDomain" on bean "BeanId(LiveCycleES4#adobe-pof.jar#adobe_POFDataDictionaryLocalEJB, null)". Exception data: com.gemstone.gemfire.cache.DiskAccessException: For DiskStore: ReplicatedGuaranteed_POF_DD_CACHE: Could not lock "/data/exigen_test/PT/jvm/tmp/adobews__-581654660/Caching/Data/ReplicatedGuaranteed_POF_DD_CACHE/DRLK_IFReplicatedGuaranteed_POF_DD_CACHE.lk". Other JVMs might have created diskstore with same name using the same directory., caused by java.io.IOException: No locks available

    at com.gemstone.gemfire.internal.cache.DiskStoreImpl.createLockFile(DiskStoreImpl.java:1800)
    at com.gemstone.gemfire.internal.cache.DiskStoreImpl.loadFiles(DiskStoreImpl.java:1920)
    at com.gemstone.gemfire.internal.cache.DiskStoreImpl.<init>(DiskStoreImpl.java:355)
    at com.gemstone.gemfire.internal.cache.DiskStoreImpl.<init>(DiskStoreImpl.java:270)
    at com.gemstone.gemfire.internal.cache.DiskStoreImpl.<init>(DiskStoreImpl.java:265)
    at com.gemstone.gemfire.internal.cache.DiskStoreFactoryImpl.create(DiskStoreFactoryImpl.java:127)
    at com.adobe.livecycle.cache.adapter.GemfireCacheAdapter.createSubRegion(GemfireCacheAdapter.java:1043)
    at com.adobe.livecycle.cache.adapter.GemfireCacheAdapter.init(GemfireCacheAdapter.java:234)
    at com.adobe.livecycle.cache.adapter.GemfireCacheAdapter.<init>(GemfireCacheAdapter.java:215)
    at com.adobe.livecycle.cache.adapter.CacheAdapterFactory.getCache(CacheAdapterFactory.java:103)
    at com.adobe.pof.POFUtil.getPOFDataDictionaryCache(POFUtil.java:525)
    at com.adobe.pof.adapter.AbstractAdapterContext.getDataDictionaryCache(AbstractAdapterContext.java:89)
    at com.adobe.pof.adapter.AbstractAdapterContext.getDomainFromCache(AbstractAdapterContext.java:127)
    at com.adobe.pof.adapter.JDBCAdapter.getDomain(JDBCAdapter.java:4436)
    at com.adobe.pof.schema.POFDataDictionaryImpl.getDomain(POFDataDictionaryImpl.java:113)
    at com.adobe.pof.schema.POFDataDictionaryRemoteBean.getDomain(POFDataDictionaryRemoteBean.java:148)
    at com.adobe.pof.schema.EJSLocalStatelessadobe_POFDataDictionaryLocalEJB_4137caa5.getDomain(Unknown Source)
    at com.adobe.pof.schema.POFDataDictionaryLocalEJBAdapter.getDomain(POFDataDictionaryLocalEJBAdapter.java:69)
    at com.adobe.pof.odapi.POFSchemaManagerRemoteBean.getDomain(POFSchemaManagerRemoteBean.java:577)
    at com.adobe.pof.odapi.EJSLocalStatelessadobe_POFSchemaManagerLocalEJB_626825cc.getDomain(Unknown Source)
    at com.adobe.pof.odapi.POFSchemaManagerLocalEJBAdapter.getDomain(POFSchemaManagerLocalEJBAdapter.java:169)
    at com.adobe.idp.dsc.startup.DSCStartupServlet$1.doInTransaction(DSCStartupServlet.java:137)
    at com.adobe.idp.dsc.transaction.impl.ejb.adapter.EjbTransactionBMTAdapterBean.doRequiresNew(EjbTransactionBMTAdapterBean.java:218)
    at com.adobe.idp.dsc.transaction.impl.ejb.adapter.EJSLocalStatelessEjbTransactionBMTAdapter_3af08fdf.doRequiresNew(Unknown Source)
    at com.adobe.idp.dsc.transaction.impl.ejb.EjbTransactionProvider.execute(EjbTransactionProvider.java:133)
    at com.adobe.idp.dsc.transaction.impl.DefaultTransactionTemplate.execute(DefaultTransactionTemplate.java:79)
    at com.adobe.idp.dsc.startup.DSCStartupServlet.init(DSCStartupServlet.java:132)
    at javax.servlet.GenericServlet.init(GenericServlet.java:161)
    at com.ibm.ws.webcontainer.servlet.ServletWrapper.init(ServletWrapper.java:342)
    at com.ibm.ws.webcontainer.servlet.ServletWrapperImpl.init(ServletWrapperImpl.java:168)
    at com.ibm.ws.webcontainer.servlet.ServletWrapper.loadOnStartupCheck(ServletWrapper.java:1366)
    at com.ibm.ws.webcontainer.webapp.WebApp.doLoadOnStartupActions(WebApp.java:618)
    at com.ibm.ws.webcontainer.webapp.WebApp.commonInitializationFinally(WebApp.java:587)
    at com.ibm.ws.webcontainer.webapp.WebAppImpl.initialize(WebAppImpl.java:421)
    at com.ibm.ws.webcontainer.webapp.WebGroupImpl.addWebApplication(WebGroupImpl.java:88)
    at com.ibm.ws.webcontainer.VirtualHostImpl.addWebApplication(VirtualHostImpl.java:169)
    at com.ibm.ws.webcontainer.WSWebContainer.addWebApp(WSWebContainer.java:749)
    at com.ibm.ws.webcontainer.WSWebContainer.addWebApplication(WSWebContainer.java:634)
    at com.ibm.ws.webcontainer.component.WebContainerImpl.install(WebContainerImpl.java:422)
    at com.ibm.ws.webcontainer.component.WebContainerImpl.start(WebContainerImpl.java:714)
    at com.ibm.ws.runtime.component.ApplicationMgrImpl.start(ApplicationMgrImpl.java:1165)
    at com.ibm.ws.runtime.component.DeployedApplicationImpl.fireDeployedObjectStart(DeployedApplicationImpl.java:1369)
    at com.ibm.ws.runtime.component.DeployedModuleImpl.start(DeployedModuleImpl.java:639)
    at com.ibm.ws.runtime.component.DeployedApplicationImpl.start(DeployedApplicationImpl.java:967)
    at com.ibm.ws.runtime.component.ApplicationMgrImpl.startApplication(ApplicationMgrImpl.java:771)
    at com.ibm.ws.runtime.component.ApplicationMgrImpl$5.run(ApplicationMgrImpl.java:2169)
    at com.ibm.ws.security.auth.ContextManagerImpl.runAs(ContextManagerImpl.java:5468)
    at com.ibm.ws.security.auth.ContextManagerImpl.runAsSystem(ContextManagerImpl.java:5594)
    at com.ibm.ws.security.core.SecurityContext.runAsSystem(SecurityContext.java:255)
    at com.ibm.ws.runtime.component.ApplicationMgrImpl.start(ApplicationMgrImpl.java:2174)
    at com.ibm.ws.runtime.component.CompositionUnitMgrImpl.start(CompositionUnitMgrImpl.java:389)
    at com.ibm.ws.runtime.component.CompositionUnitImpl.start(CompositionUnitImpl.java:123)

  at com.ibm.wsspi.runtime.component.WsComponentImpl$_AsynchInitializer.run(WsComponentImpl.java:496)

        at com.ibm.ws.util.ThreadPool$Worker.run(ThreadPool.java:1702)

Caused by: java.io.IOException: No locks available

        at sun.nio.ch.FileChannelImpl.tryLock(FileChannelImpl.java:924)

        at java.nio.channels.FileChannel.tryLock(FileChannel.java:973)

        at com.gemstone.gemfire.internal.cache.DiskStoreImpl.createLockFile(DiskStoreImpl.java:1781)

        ... 56 more

Any immediate help would be appreciated to resolve the issue. Thank you.

1 Reply