Expand my Community achievements bar.

LC ES2 error - SynchronizationDAO.acquireClusterLock

Avatar

Level 3

I have just done an install of ES2 SP1, on SUSE11 / JBoss / MySQL.

The server appears to be working fine, but I am getting the following error occur every 13 minutes in the JBoss log file. (00, 13, 26, 39, 52 minutes past each hour)

Obviously its Quartz running it, but any ideas whats causing it?

Even though the error is acquireClusterLock, its a single server installation.  I have attached the server log after a JBoss restart, and it states

2010-06-23 15:13:39,819 INFO  [org.quartz.core.QuartzScheduler] Scheduler SimpleQuartzScheduler_$_SIMPLE_NON_CLUSTERED started.

The error does not start appearing straight away after a restart, but it started sometime overnight.

It looks similar to this thread - QUARTZ_JOBGROUP_IDP.DIRSYNC_FINISHER_JOB threw an exception.

http://forums.adobe.com/thread/538594

Voluntary Product Accessibility TemplateVoluntary Product Accessibility TemplateVoluntary Product Accessibility Template

2010-06-24 00:00:00,013 WARN  [org.hibernate.util.JDBCExceptionReporter] SQL Error: 0, SQLState: null

2010-06-24 00:00:00,014 ERROR [org.hibernate.util.JDBCExceptionReporter] You are trying to use a connection factory that has been shut down: ManagedConnectionFactory is null.; - nested throwable: (javax.resource.ResourceException: You are trying to use a connection factory that has been shut down: ManagedConnectionFactory is null.)

2010-06-24 00:00:00,014 ERROR [org.jboss.ejb.plugins.LogInterceptor] RuntimeException in method: public abstract com.adobe.idp.um.businesslogic.synch.dao.SynchronizationDAO$LockAcquireResult com.adobe.idp.um.businesslogic.synch.dao.SynchronizationDAO.acquireClusterLock(com.adobe.idp.um.scheduler.JobType):

org.hibernate.exception.GenericJDBCException: Cannot open connection

       at org.hibernate.exception.SQLStateConverter.handledNonSpecificException(SQLStateConverter.java:103)

       at org.hibernate.exception.SQLStateConverter.convert(SQLStateConverter.java:91)

       at org.hibernate.exception.JDBCExceptionHelper.convert(JDBCExceptionHelper.java:43)

       at org.hibernate.exception.JDBCExceptionHelper.convert(JDBCExceptionHelper.java:29)

       at org.hibernate.jdbc.ConnectionManager.openConnection(ConnectionManager.java:426)

       at org.hibernate.jdbc.ConnectionManager.getConnection(ConnectionManager.java:144)

       at org.hibernate.jdbc.AbstractBatcher.prepareQueryStatement(AbstractBatcher.java:139)

       at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:1547)

       at org.hibernate.loader.Loader.doQuery(Loader.java:673)

       at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:236)

       at org.hibernate.loader.Loader.doList(Loader.java:2220)

       at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2104)

       at org.hibernate.loader.Loader.list(Loader.java:2099)

       at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:378)

       at org.hibernate.hql.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:338)

       at org.hibernate.engine.query.HQLQueryPlan.performList(HQLQueryPlan.java:172)

       at org.hibernate.impl.SessionImpl.list(SessionImpl.java:1121)

       at org.hibernate.impl.QueryImpl.list(QueryImpl.java:79)

       at com.adobe.idp.um.businesslogic.synch.hibernate.HibernateSynchronizationDao.getLockEntity(HibernateSynchronizationDao.java:1193)

       at com.adobe.idp.um.businesslogic.synch.hibernate.HibernateSynchronizationDao.acquireClusterLock(HibernateSynchronizationDao.java:1082)

       at sun.reflect.GeneratedMethodAccessor1025.invoke(Unknown Source)

       at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)

       at java.lang.reflect.Method.invoke(Unknown Source)

       at org.jboss.invocation.Invocation.performCall(Invocation.java:359)

       at org.jboss.ejb.StatelessSessionContainer$ContainerInterceptor.invoke(StatelessSessionContainer.java:237)

       at org.jboss.resource.connectionmanager.CachedConnectionInterceptor.invoke(CachedConnectionInterceptor.java:158)

       at org.jboss.ejb.plugins.StatelessSessionInstanceInterceptor.invoke(StatelessSessionInstanceInterceptor.java:169)

       at org.jboss.ejb.plugins.CallValidationInterceptor.invoke(CallValidationInterceptor.java:63)

       at org.jboss.ejb.plugins.AbstractTxInterceptor.invokeNext(AbstractTxInterceptor.java:121)

       at org.jboss.ejb.plugins.TxInterceptorCMT.runWithTransactions(TxInterceptorCMT.java:350)

       at org.jboss.ejb.plugins.TxInterceptorCMT.invoke(TxInterceptorCMT.java:181)

       at org.jboss.ejb.plugins.SecurityInterceptor.invoke(SecurityInterceptor.java:168)

       at org.jboss.ejb.plugins.LogInterceptor.invoke(LogInterceptor.java:205)

       at org.jboss.ejb.plugins.ProxyFactoryFinderInterceptor.invoke(ProxyFactoryFinderInterceptor.java:138)

       at org.jboss.ejb.SessionContainer.internalInvoke(SessionContainer.java:648)

       at org.jboss.ejb.Container.invoke(Container.java:960)

       at org.jboss.ejb.plugins.local.BaseLocalProxyFactory.invoke(BaseLocalProxyFactory.java:430)

       at org.jboss.ejb.plugins.local.StatelessSessionProxy.invoke(StatelessSessionProxy.java:103)

       at $Proxy205.acquireClusterLock(Unknown Source)

       at com.adobe.idp.um.scheduler.AbstractClusterJob.execute(AbstractClusterJob.java:76)

       at org.quartz.core.JobRunShell.run(JobRunShell.java:202)

       at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:529)

Caused by: org.jboss.util.NestedSQLException: You are trying to use a connection factory that has been shut down: ManagedConnectionFactory is null.; - nested throwable: (javax.resource.ResourceException: You are trying to use a connection factory that has been shut down: ManagedConnectionFactory is null.)

       at org.jboss.resource.adapter.jdbc.WrapperDataSource.getConnection(WrapperDataSource.java:94)

       at org.hibernate.connection.DatasourceConnectionProvider.getConnection(DatasourceConnectionProvider.java:69)

       at org.hibernate.jdbc.ConnectionManager.openConnection(ConnectionManager.java:423)

       ... 37 more

Caused by: javax.resource.ResourceException: You are trying to use a connection factory that has been shut down: ManagedConnectionFactory is null.

       at org.jboss.resource.connectionmanager.BaseConnectionManager2.allocateConnection(BaseConnectionManager2.java:387)

       at org.jboss.resource.connectionmanager.BaseConnectionManager2$ConnectionManagerProxy.allocateConnection(BaseConnectionManager2.java:842)

       at org.jboss.resource.adapter.jdbc.WrapperDataSource.getConnection(WrapperDataSource.java:88)

       ... 39 more

2010-06-24 00:00:00,015 ERROR [org.quartz.core.JobRunShell] Job QUARTZ_JOBGROUP_IDP.DIRSYNC_FINISHER_JOB threw an unhandled Exception:

javax.ejb.EJBException: RuntimeException

       at org.jboss.ejb.plugins.LogInterceptor.handleException(LogInterceptor.java:417)

       at org.jboss.ejb.plugins.LogInterceptor.invoke(LogInterceptor.java:209)

       at org.jboss.ejb.plugins.ProxyFactoryFinderInterceptor.invoke(ProxyFactoryFinderInterceptor.java:138)

       at org.jboss.ejb.SessionContainer.internalInvoke(SessionContainer.java:648)

       at org.jboss.ejb.Container.invoke(Container.java:960)

       at org.jboss.ejb.plugins.local.BaseLocalProxyFactory.invoke(BaseLocalProxyFactory.java:430)

       at org.jboss.ejb.plugins.local.StatelessSessionProxy.invoke(StatelessSessionProxy.java:103)

       at $Proxy205.acquireClusterLock(Unknown Source)

       at com.adobe.idp.um.scheduler.AbstractClusterJob.execute(AbstractClusterJob.java:76)

       at org.quartz.core.JobRunShell.run(JobRunShell.java:202)

       at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:529)

Caused by: org.hibernate.exception.GenericJDBCException: Cannot open connection

       at org.hibernate.exception.SQLStateConverter.handledNonSpecificException(SQLStateConverter.java:103)

       at org.hibernate.exception.SQLStateConverter.convert(SQLStateConverter.java:91)

       at org.hibernate.exception.JDBCExceptionHelper.convert(JDBCExceptionHelper.java:43)

       at org.hibernate.exception.JDBCExceptionHelper.convert(JDBCExceptionHelper.java:29)

       at org.hibernate.jdbc.ConnectionManager.openConnection(ConnectionManager.java:426)

       at org.hibernate.jdbc.ConnectionManager.getConnection(ConnectionManager.java:144)

       at org.hibernate.jdbc.AbstractBatcher.prepareQueryStatement(AbstractBatcher.java:139)

       at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:1547)

       at org.hibernate.loader.Loader.doQuery(Loader.java:673)

       at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:236)

       at org.hibernate.loader.Loader.doList(Loader.java:2220)

       at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2104)

       at org.hibernate.loader.Loader.list(Loader.java:2099)

       at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:378)

       at org.hibernate.hql.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:338)

       at org.hibernate.engine.query.HQLQueryPlan.performList(HQLQueryPlan.java:172)

       at org.hibernate.impl.SessionImpl.list(SessionImpl.java:1121)

       at org.hibernate.impl.QueryImpl.list(QueryImpl.java:79)

       at com.adobe.idp.um.businesslogic.synch.hibernate.HibernateSynchronizationDao.getLockEntity(HibernateSynchronizationDao.java:1193)

       at com.adobe.idp.um.businesslogic.synch.hibernate.HibernateSynchronizationDao.acquireClusterLock(HibernateSynchronizationDao.java:1082)

       at sun.reflect.GeneratedMethodAccessor1025.invoke(Unknown Source)

       at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)

       at java.lang.reflect.Method.invoke(Unknown Source)

       at org.jboss.invocation.Invocation.performCall(Invocation.java:359)

       at org.jboss.ejb.StatelessSessionContainer$ContainerInterceptor.invoke(StatelessSessionContainer.java:237)

       at org.jboss.resource.connectionmanager.CachedConnectionInterceptor.invoke(CachedConnectionInterceptor.java:158)

       at org.jboss.ejb.plugins.StatelessSessionInstanceInterceptor.invoke(StatelessSessionInstanceInterceptor.java:169)

       at org.jboss.ejb.plugins.CallValidationInterceptor.invoke(CallValidationInterceptor.java:63)

       at org.jboss.ejb.plugins.AbstractTxInterceptor.invokeNext(AbstractTxInterceptor.java:121)

       at org.jboss.ejb.plugins.TxInterceptorCMT.runWithTransactions(TxInterceptorCMT.java:350)

       at org.jboss.ejb.plugins.TxInterceptorCMT.invoke(TxInterceptorCMT.java:181)

       at org.jboss.ejb.plugins.SecurityInterceptor.invoke(SecurityInterceptor.java:168)

       at org.jboss.ejb.plugins.LogInterceptor.invoke(LogInterceptor.java:205)

       ... 9 more

Caused by: org.jboss.util.NestedSQLException: You are trying to use a connection factory that has been shut down: ManagedConnectionFactory is null.; - nested throwable: (javax.resource.ResourceException: You are trying to use a connection factory that has been shut down: ManagedConnectionFactory is null.)

       at org.jboss.resource.adapter.jdbc.WrapperDataSource.getConnection(WrapperDataSource.java:94)

       at org.hibernate.connection.DatasourceConnectionProvider.getConnection(DatasourceConnectionProvider.java:69)

       at org.hibernate.jdbc.ConnectionManager.openConnection(ConnectionManager.java:423)

       ... 37 more

Caused by: javax.resource.ResourceException: You are trying to use a connection factory that has been shut down: ManagedConnectionFactory is null.

       at org.jboss.resource.connectionmanager.BaseConnectionManager2.allocateConnection(BaseConnectionManager2.java:387)

       at org.jboss.resource.connectionmanager.BaseConnectionManager2$ConnectionManagerProxy.allocateConnection(BaseConnectionManager2.java:842)

       at org.jboss.resource.adapter.jdbc.WrapperDataSource.getConnection(WrapperDataSource.java:88)

       ... 39 more

2010-06-24 00:00:00,015 ERROR [org.quartz.core.ErrorLogger] Job (QUARTZ_JOBGROUP_IDP.DIRSYNC_FINISHER_JOB threw an exception.

org.quartz.SchedulerException: Job threw an unhandled exception. [See nested exception: javax.ejb.EJBException: RuntimeException]

       at org.quartz.core.JobRunShell.run(JobRunShell.java:213)

       at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:529)

Caused by: javax.ejb.EJBException: RuntimeException

       at org.jboss.ejb.plugins.LogInterceptor.handleException(LogInterceptor.java:417)

       at org.jboss.ejb.plugins.LogInterceptor.invoke(LogInterceptor.java:209)

       at org.jboss.ejb.plugins.ProxyFactoryFinderInterceptor.invoke(ProxyFactoryFinderInterceptor.java:138)

       at org.jboss.ejb.SessionContainer.internalInvoke(SessionContainer.java:648)

       at org.jboss.ejb.Container.invoke(Container.java:960)

       at org.jboss.ejb.plugins.local.BaseLocalProxyFactory.invoke(BaseLocalProxyFactory.java:430)

       at org.jboss.ejb.plugins.local.StatelessSessionProxy.invoke(StatelessSessionProxy.java:103)

       at $Proxy205.acquireClusterLock(Unknown Source)

       at com.adobe.idp.um.scheduler.AbstractClusterJob.execute(AbstractClusterJob.java:76)

       at org.quartz.core.JobRunShell.run(JobRunShell.java:202)

       ... 1 more

Caused by: org.hibernate.exception.GenericJDBCException: Cannot open connection

       at org.hibernate.exception.SQLStateConverter.handledNonSpecificException(SQLStateConverter.java:103)

       at org.hibernate.exception.SQLStateConverter.convert(SQLStateConverter.java:91)

       at org.hibernate.exception.JDBCExceptionHelper.convert(JDBCExceptionHelper.java:43)

       at org.hibernate.exception.JDBCExceptionHelper.convert(JDBCExceptionHelper.java:29)

       at org.hibernate.jdbc.ConnectionManager.openConnection(ConnectionManager.java:426)

       at org.hibernate.jdbc.ConnectionManager.getConnection(ConnectionManager.java:144)

       at org.hibernate.jdbc.AbstractBatcher.prepareQueryStatement(AbstractBatcher.java:139)

       at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:1547)

       at org.hibernate.loader.Loader.doQuery(Loader.java:673)

       at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:236)

       at org.hibernate.loader.Loader.doList(Loader.java:2220)

       at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2104)

       at org.hibernate.loader.Loader.list(Loader.java:2099)

       at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:378)

       at org.hibernate.hql.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:338)

       at org.hibernate.engine.query.HQLQueryPlan.performList(HQLQueryPlan.java:172)

       at org.hibernate.impl.SessionImpl.list(SessionImpl.java:1121)

       at org.hibernate.impl.QueryImpl.list(QueryImpl.java:79)

       at com.adobe.idp.um.businesslogic.synch.hibernate.HibernateSynchronizationDao.getLockEntity(HibernateSynchronizationDao.java:1193)

       at com.adobe.idp.um.businesslogic.synch.hibernate.HibernateSynchronizationDao.acquireClusterLock(HibernateSynchronizationDao.java:1082)

       at sun.reflect.GeneratedMethodAccessor1025.invoke(Unknown Source)

       at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)

       at java.lang.reflect.Method.invoke(Unknown Source)

       at org.jboss.invocation.Invocation.performCall(Invocation.java:359)

       at org.jboss.ejb.StatelessSessionContainer$ContainerInterceptor.invoke(StatelessSessionContainer.java:237)

       at org.jboss.resource.connectionmanager.CachedConnectionInterceptor.invoke(CachedConnectionInterceptor.java:158)

       at org.jboss.ejb.plugins.StatelessSessionInstanceInterceptor.invoke(StatelessSessionInstanceInterceptor.java:169)

       at org.jboss.ejb.plugins.CallValidationInterceptor.invoke(CallValidationInterceptor.java:63)

       at org.jboss.ejb.plugins.AbstractTxInterceptor.invokeNext(AbstractTxInterceptor.java:121)

       at org.jboss.ejb.plugins.TxInterceptorCMT.runWithTransactions(TxInterceptorCMT.java:350)

       at org.jboss.ejb.plugins.TxInterceptorCMT.invoke(TxInterceptorCMT.java:181)

       at org.jboss.ejb.plugins.SecurityInterceptor.invoke(SecurityInterceptor.java:168)

       at org.jboss.ejb.plugins.LogInterceptor.invoke(LogInterceptor.java:205)

       ... 9 more

Caused by: org.jboss.util.NestedSQLException: You are trying to use a connection factory that has been shut down: ManagedConnectionFactory is null.; - nested throwable: (javax.resource.ResourceException: You are trying to use a connection factory that has been shut down: ManagedConnectionFactory is null.)

       at org.jboss.resource.adapter.jdbc.WrapperDataSource.getConnection(WrapperDataSource.java:94)

       at org.hibernate.connection.DatasourceConnectionProvider.getConnection(DatasourceConnectionProvider.java:69)

       at org.hibernate.jdbc.ConnectionManager.openConnection(ConnectionManager.java:423)

       ... 37 more

Caused by: javax.resource.ResourceException: You are trying to use a connection factory that has been shut down: ManagedConnectionFactory is null.

       at org.jboss.resource.connectionmanager.BaseConnectionManager2.allocateConnection(BaseConnectionManager2.java:387)

       at org.jboss.resource.connectionmanager.BaseConnectionManager2$ConnectionManagerProxy.allocateConnection(BaseConnectionManager2.java:842)

       at org.jboss.resource.adapter.jdbc.WrapperDataSource.getConnection(WrapperDataSource.java:88)

       ... 39 more 2010-06-24 00:00:00,013 WARN  [org.hibernate.util.JDBCExceptionReporter] SQL Error: 0, SQLState: null

2010-06-24 00:00:00,014 ERROR [org.hibernate.util.JDBCExceptionReporter] You are trying to use a connection factory that has been shut down: ManagedConnectionFactory is null.; - nested throwable: (javax.resource.ResourceException: You are trying to use a connection factory that has been shut down: ManagedConnectionFactory is null.)

2010-06-24 00:00:00,014 ERROR [org.jboss.ejb.plugins.LogInterceptor] RuntimeException in method: public abstract com.adobe.idp.um.businesslogic.synch.dao.SynchronizationDAO$LockAcquireResult com.adobe.idp.um.businesslogic.synch.dao.SynchronizationDAO.acquireClusterLock(com.adobe.idp.um.scheduler.JobType):

org.hibernate.exception.GenericJDBCException: Cannot open connection

       at org.hibernate.exception.SQLStateConverter.handledNonSpecificException(SQLStateConverter.java:103)

       at org.hibernate.exception.SQLStateConverter.convert(SQLStateConverter.java:91)

       at org.hibernate.exception.JDBCExceptionHelper.convert(JDBCExceptionHelper.java:43)

       at org.hibernate.exception.JDBCExceptionHelper.convert(JDBCExceptionHelper.java:29)

       at org.hibernate.jdbc.ConnectionManager.openConnection(ConnectionManager.java:426)

       at org.hibernate.jdbc.ConnectionManager.getConnection(ConnectionManager.java:144)

       at org.hibernate.jdbc.AbstractBatcher.prepareQueryStatement(AbstractBatcher.java:139)

       at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:1547)

       at org.hibernate.loader.Loader.doQuery(Loader.java:673)

       at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:236)

       at org.hibernate.loader.Loader.doList(Loader.java:2220)

       at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2104)

       at org.hibernate.loader.Loader.list(Loader.java:2099)

       at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:378)

       at org.hibernate.hql.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:338)

       at org.hibernate.engine.query.HQLQueryPlan.performList(HQLQueryPlan.java:172)

       at org.hibernate.impl.SessionImpl.list(SessionImpl.java:1121)

       at org.hibernate.impl.QueryImpl.list(QueryImpl.java:79)

       at com.adobe.idp.um.businesslogic.synch.hibernate.HibernateSynchronizationDao.getLockEntity(HibernateSynchronizationDao.java:1193)

       at com.adobe.idp.um.businesslogic.synch.hibernate.HibernateSynchronizationDao.acquireClusterLock(HibernateSynchronizationDao.java:1082)

       at sun.reflect.GeneratedMethodAccessor1025.invoke(Unknown Source)

       at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)

       at java.lang.reflect.Method.invoke(Unknown Source)

       at org.jboss.invocation.Invocation.performCall(Invocation.java:359)

       at org.jboss.ejb.StatelessSessionContainer$ContainerInterceptor.invoke(StatelessSessionContainer.java:237)

       at org.jboss.resource.connectionmanager.CachedConnectionInterceptor.invoke(CachedConnectionInterceptor.java:158)

       at org.jboss.ejb.plugins.StatelessSessionInstanceInterceptor.invoke(StatelessSessionInstanceInterceptor.java:169)

       at org.jboss.ejb.plugins.CallValidationInterceptor.invoke(CallValidationInterceptor.java:63)

       at org.jboss.ejb.plugins.AbstractTxInterceptor.invokeNext(AbstractTxInterceptor.java:121)

       at org.jboss.ejb.plugins.TxInterceptorCMT.runWithTransactions(TxInterceptorCMT.java:350)

       at org.jboss.ejb.plugins.TxInterceptorCMT.invoke(TxInterceptorCMT.java:181)

       at org.jboss.ejb.plugins.SecurityInterceptor.invoke(SecurityInterceptor.java:168)

       at org.jboss.ejb.plugins.LogInterceptor.invoke(LogInterceptor.java:205)

       at org.jboss.ejb.plugins.ProxyFactoryFinderInterceptor.invoke(ProxyFactoryFinderInterceptor.java:138)

       at org.jboss.ejb.SessionContainer.internalInvoke(SessionContainer.java:648)

       at org.jboss.ejb.Container.invoke(Container.java:960)

       at org.jboss.ejb.plugins.local.BaseLocalProxyFactory.invoke(BaseLocalProxyFactory.java:430)

       at org.jboss.ejb.plugins.local.StatelessSessionProxy.invoke(StatelessSessionProxy.java:103)

       at $Proxy205.acquireClusterLock(Unknown Source)

       at com.adobe.idp.um.scheduler.AbstractClusterJob.execute(AbstractClusterJob.java:76)

       at org.quartz.core.JobRunShell.run(JobRunShell.java:202)

       at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:529)

Caused by: org.jboss.util.NestedSQLException: You are trying to use a connection factory that has been shut down: ManagedConnectionFactory is null.; - nested throwable: (javax.resource.ResourceException: You are trying to use a connection factory that has been shut down: ManagedConnectionFactory is null.)

       at org.jboss.resource.adapter.jdbc.WrapperDataSource.getConnection(WrapperDataSource.java:94)

       at org.hibernate.connection.DatasourceConnectionProvider.getConnection(DatasourceConnectionProvider.java:69)

       at org.hibernate.jdbc.ConnectionManager.openConnection(ConnectionManager.java:423)

       ... 37 more

Caused by: javax.resource.ResourceException: You are trying to use a connection factory that has been shut down: ManagedConnectionFactory is null.

       at org.jboss.resource.connectionmanager.BaseConnectionManager2.allocateConnection(BaseConnectionManager2.java:387)

       at org.jboss.resource.connectionmanager.BaseConnectionManager2$ConnectionManagerProxy.allocateConnection(BaseConnectionManager2.java:842)

       at org.jboss.resource.adapter.jdbc.WrapperDataSource.getConnection(WrapperDataSource.java:88)

       ... 39 more

2010-06-24 00:00:00,015 ERROR [org.quartz.core.JobRunShell] Job QUARTZ_JOBGROUP_IDP.DIRSYNC_FINISHER_JOB threw an unhandled Exception:

javax.ejb.EJBException: RuntimeException

       at org.jboss.ejb.plugins.LogInterceptor.handleException(LogInterceptor.java:417)

       at org.jboss.ejb.plugins.LogInterceptor.invoke(LogInterceptor.java:209)

       at org.jboss.ejb.plugins.ProxyFactoryFinderInterceptor.invoke(ProxyFactoryFinderInterceptor.java:138)

       at org.jboss.ejb.SessionContainer.internalInvoke(SessionContainer.java:648)

       at org.jboss.ejb.Container.invoke(Container.java:960)

       at org.jboss.ejb.plugins.local.BaseLocalProxyFactory.invoke(BaseLocalProxyFactory.java:430)

       at org.jboss.ejb.plugins.local.StatelessSessionProxy.invoke(StatelessSessionProxy.java:103)

       at $Proxy205.acquireClusterLock(Unknown Source)

       at com.adobe.idp.um.scheduler.AbstractClusterJob.execute(AbstractClusterJob.java:76)

       at org.quartz.core.JobRunShell.run(JobRunShell.java:202)

       at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:529)

Caused by: org.hibernate.exception.GenericJDBCException: Cannot open connection

       at org.hibernate.exception.SQLStateConverter.handledNonSpecificException(SQLStateConverter.java:103)

       at org.hibernate.exception.SQLStateConverter.convert(SQLStateConverter.java:91)

       at org.hibernate.exception.JDBCExceptionHelper.convert(JDBCExceptionHelper.java:43)

       at org.hibernate.exception.JDBCExceptionHelper.convert(JDBCExceptionHelper.java:29)

       at org.hibernate.jdbc.ConnectionManager.openConnection(ConnectionManager.java:426)

       at org.hibernate.jdbc.ConnectionManager.getConnection(ConnectionManager.java:144)

       at org.hibernate.jdbc.AbstractBatcher.prepareQueryStatement(AbstractBatcher.java:139)

       at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:1547)

       at org.hibernate.loader.Loader.doQuery(Loader.java:673)

       at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:236)

       at org.hibernate.loader.Loader.doList(Loader.java:2220)

       at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2104)

       at org.hibernate.loader.Loader.list(Loader.java:2099)

       at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:378)

       at org.hibernate.hql.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:338)

       at org.hibernate.engine.query.HQLQueryPlan.performList(HQLQueryPlan.java:172)

       at org.hibernate.impl.SessionImpl.list(SessionImpl.java:1121)

       at org.hibernate.impl.QueryImpl.list(QueryImpl.java:79)

       at com.adobe.idp.um.businesslogic.synch.hibernate.HibernateSynchronizationDao.getLockEntity(HibernateSynchronizationDao.java:1193)

       at com.adobe.idp.um.businesslogic.synch.hibernate.HibernateSynchronizationDao.acquireClusterLock(HibernateSynchronizationDao.java:1082)

       at sun.reflect.GeneratedMethodAccessor1025.invoke(Unknown Source)

       at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)

       at java.lang.reflect.Method.invoke(Unknown Source)

       at org.jboss.invocation.Invocation.performCall(Invocation.java:359)

       at org.jboss.ejb.StatelessSessionContainer$ContainerInterceptor.invoke(StatelessSessionContainer.java:237)

       at org.jboss.resource.connectionmanager.CachedConnectionInterceptor.invoke(CachedConnectionInterceptor.java:158)

       at org.jboss.ejb.plugins.StatelessSessionInstanceInterceptor.invoke(StatelessSessionInstanceInterceptor.java:169)

       at org.jboss.ejb.plugins.CallValidationInterceptor.invoke(CallValidationInterceptor.java:63)

       at org.jboss.ejb.plugins.AbstractTxInterceptor.invokeNext(AbstractTxInterceptor.java:121)

       at org.jboss.ejb.plugins.TxInterceptorCMT.runWithTransactions(TxInterceptorCMT.java:350)

       at org.jboss.ejb.plugins.TxInterceptorCMT.invoke(TxInterceptorCMT.java:181)

       at org.jboss.ejb.plugins.SecurityInterceptor.invoke(SecurityInterceptor.java:168)

       at org.jboss.ejb.plugins.LogInterceptor.invoke(LogInterceptor.java:205)

       ... 9 more

Caused by: org.jboss.util.NestedSQLException: You are trying to use a connection factory that has been shut down: ManagedConnectionFactory is null.; - nested throwable: (javax.resource.ResourceException: You are trying to use a connection factory that has been shut down: ManagedConnectionFactory is null.)

       at org.jboss.resource.adapter.jdbc.WrapperDataSource.getConnection(WrapperDataSource.java:94)

       at org.hibernate.connection.DatasourceConnectionProvider.getConnection(DatasourceConnectionProvider.java:69)

       at org.hibernate.jdbc.ConnectionManager.openConnection(ConnectionManager.java:423)

       ... 37 more

Caused by: javax.resource.ResourceException: You are trying to use a connection factory that has been shut down: ManagedConnectionFactory is null.

       at org.jboss.resource.connectionmanager.BaseConnectionManager2.allocateConnection(BaseConnectionManager2.java:387)

       at org.jboss.resource.connectionmanager.BaseConnectionManager2$ConnectionManagerProxy.allocateConnection(BaseConnectionManager2.java:842)

       at org.jboss.resource.adapter.jdbc.WrapperDataSource.getConnection(WrapperDataSource.java:88)

       ... 39 more

2010-06-24 00:00:00,015 ERROR [org.quartz.core.ErrorLogger] Job (QUARTZ_JOBGROUP_IDP.DIRSYNC_FINISHER_JOB threw an exception.

org.quartz.SchedulerException: Job threw an unhandled exception. [See nested exception: javax.ejb.EJBException: RuntimeException]

       at org.quartz.core.JobRunShell.run(JobRunShell.java:213)

       at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:529)

Caused by: javax.ejb.EJBException: RuntimeException

       at org.jboss.ejb.plugins.LogInterceptor.handleException(LogInterceptor.java:417)

       at org.jboss.ejb.plugins.LogInterceptor.invoke(LogInterceptor.java:209)

       at org.jboss.ejb.plugins.ProxyFactoryFinderInterceptor.invoke(ProxyFactoryFinderInterceptor.java:138)

       at org.jboss.ejb.SessionContainer.internalInvoke(SessionContainer.java:648)

       at org.jboss.ejb.Container.invoke(Container.java:960)

       at org.jboss.ejb.plugins.local.BaseLocalProxyFactory.invoke(BaseLocalProxyFactory.java:430)

       at org.jboss.ejb.plugins.local.StatelessSessionProxy.invoke(StatelessSessionProxy.java:103)

       at $Proxy205.acquireClusterLock(Unknown Source)

       at com.adobe.idp.um.scheduler.AbstractClusterJob.execute(AbstractClusterJob.java:76)

       at org.quartz.core.JobRunShell.run(JobRunShell.java:202)

       ... 1 more

Caused by: org.hibernate.exception.GenericJDBCException: Cannot open connection

       at org.hibernate.exception.SQLStateConverter.handledNonSpecificException(SQLStateConverter.java:103)

       at org.hibernate.exception.SQLStateConverter.convert(SQLStateConverter.java:91)

       at org.hibernate.exception.JDBCExceptionHelper.convert(JDBCExceptionHelper.java:43)

       at org.hibernate.exception.JDBCExceptionHelper.convert(JDBCExceptionHelper.java:29)

       at org.hibernate.jdbc.ConnectionManager.openConnection(ConnectionManager.java:426)

       at org.hibernate.jdbc.ConnectionManager.getConnection(ConnectionManager.java:144)

       at org.hibernate.jdbc.AbstractBatcher.prepareQueryStatement(AbstractBatcher.java:139)

       at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:1547)

       at org.hibernate.loader.Loader.doQuery(Loader.java:673)

       at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:236)

       at org.hibernate.loader.Loader.doList(Loader.java:2220)

       at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2104)

       at org.hibernate.loader.Loader.list(Loader.java:2099)

       at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:378)

       at org.hibernate.hql.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:338)

       at org.hibernate.engine.query.HQLQueryPlan.performList(HQLQueryPlan.java:172)

       at org.hibernate.impl.SessionImpl.list(SessionImpl.java:1121)

       at org.hibernate.impl.QueryImpl.list(QueryImpl.java:79)

       at com.adobe.idp.um.businesslogic.synch.hibernate.HibernateSynchronizationDao.getLockEntity(HibernateSynchronizationDao.java:1193)

       at com.adobe.idp.um.businesslogic.synch.hibernate.HibernateSynchronizationDao.acquireClusterLock(HibernateSynchronizationDao.java:1082)

       at sun.reflect.GeneratedMethodAccessor1025.invoke(Unknown Source)

       at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)

       at java.lang.reflect.Method.invoke(Unknown Source)

       at org.jboss.invocation.Invocation.performCall(Invocation.java:359)

       at org.jboss.ejb.StatelessSessionContainer$ContainerInterceptor.invoke(StatelessSessionContainer.java:237)

       at org.jboss.resource.connectionmanager.CachedConnectionInterceptor.invoke(CachedConnectionInterceptor.java:158)

       at org.jboss.ejb.plugins.StatelessSessionInstanceInterceptor.invoke(StatelessSessionInstanceInterceptor.java:169)

       at org.jboss.ejb.plugins.CallValidationInterceptor.invoke(CallValidationInterceptor.java:63)

       at org.jboss.ejb.plugins.AbstractTxInterceptor.invokeNext(AbstractTxInterceptor.java:121)

       at org.jboss.ejb.plugins.TxInterceptorCMT.runWithTransactions(TxInterceptorCMT.java:350)

       at org.jboss.ejb.plugins.TxInterceptorCMT.invoke(TxInterceptorCMT.java:181)

       at org.jboss.ejb.plugins.SecurityInterceptor.invoke(SecurityInterceptor.java:168)

       at org.jboss.ejb.plugins.LogInterceptor.invoke(LogInterceptor.java:205)

       ... 9 more

Caused by: org.jboss.util.NestedSQLException: You are trying to use a connection factory that has been shut down: ManagedConnectionFactory is null.; - nested throwable: (javax.resource.ResourceException: You are trying to use a connection factory that has been shut down: ManagedConnectionFactory is null.)

       at org.jboss.resource.adapter.jdbc.WrapperDataSource.getConnection(WrapperDataSource.java:94)

       at org.hibernate.connection.DatasourceConnectionProvider.getConnection(DatasourceConnectionProvider.java:69)

       at org.hibernate.jdbc.ConnectionManager.openConnection(ConnectionManager.java:423)

       ... 37 more

Caused by: javax.resource.ResourceException: You are trying to use a connection factory that has been shut down: ManagedConnectionFactory is null.

       at org.jboss.resource.connectionmanager.BaseConnectionManager2.allocateConnection(BaseConnectionManager2.java:387)

       at org.jboss.resource.connectionmanager.BaseConnectionManager2$ConnectionManagerProxy.allocateConnection(BaseConnectionManager2.java:842)

       at org.jboss.resource.adapter.jdbc.WrapperDataSource.getConnection(WrapperDataSource.java:88)

       ... 39 more

1 Reply

Avatar

Level 4

Hi Gareth,

Here it is the synch logic which is being triggered. The use of non clustered Quartz is fine

From the exception trace it looks like the datasource is closed or you have changes the adobe-ds.xml at runtime (i.e. datasource hotdeployed).The synch logic tries to perform a sql operation and at that time founds that datasource is closed. Now this can be due to few issues

  1. The datasource xml has been changed at runtime
  2. The datssource actually got closed. May be due to system entering standby or the db closed stale connection

Can you restart the server and see if these error go away?