Re: More problems provisioning problems w/somewhat larger user base - Connection already closed

Wed, 19 Feb 2020 01:00:10 -0800 

Hi jim,

Which DBMS are you using?
Generally speaking Syncope can manage several thousands of users, much more than 50k, without any problem.
Maybe your issue is related to configuration of datasource pools. If you are using default Hikari datasource [1] you can act on Hikari pool configuration params [2] and [3], mainly the ones related to connection timeout.
If you are using tomcat jdbc datasource [4] you have to manage connetion configuration directly on the tomcat configuration. 

Best regards,
Andrea
[1] https://github.com/apache/syncope/blob/2_1_X/core/persistence-jpa/src/main/resources/domains/MasterDomain.xml#L48-L58 

[2] https://github.com/brettwooldridge/HikariCP/wiki/About-Pool-Sizing

[3] https://github.com/brettwooldridge/HikariCP#configuration-knobs-baby

Il 19/02/20 04:57, oh...@yahoo.com ha scritto:

Hi,
I am continuing to test Syncope, trying to increase the number of users.  So I started with a clean start, with only a few test users in Syncope and clean logs.  I have a CSV file with 500 users and when I attempted to process this file with Syncope, I saw the following in the core.log (this is just a snippet of the log):
03:45:48.560 INFO  hsqldb.db.HSQLDB6D91E2E024.ENGINE - checkpointClose start 03:45:48.560 INFO  hsqldb.db.HSQLDB6D91E2E024.ENGINE - checkpointClose synched 03:45:48.611 INFO  hsqldb.db.HSQLDB6D91E2E024.ENGINE - checkpointClose script done 
03:45:48.615 INFO  hsqldb.db.HSQLDB6D91E2E024.ENGINE - checkpointClose end
03:46:11.350 ERROR org.apache.syncope.core.provisioning.api.pushpull.SyncopeResultHandler - Could not create USER Auid00290 org.apache.openjpa.persistence.PersistenceException: Connection has already been closed. {SELECT dynRealm_id FROM DynRealmMembers WHERE any_id=?} [code=0, state=null]         at org.apache.openjpa.jdbc.sql.DBDictionary.narrow(DBDictionary.java:5250) ~[openjpa-jdbc-3.1.0.jar:3.1.0]         at org.apache.openjpa.jdbc.sql.DBDictionary.newStoreException(DBDictionary.java:5210) ~[openjpa-jdbc-3.1.0.jar:3.1.0]         at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:134) ~[openjpa-jdbc-3.1.0.jar:3.1.0]         at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:107) ~[openjpa-jdbc-3.1.0.jar:3.1.0]         at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:59) ~[openjpa-jdbc-3.1.0.jar:3.1.0]         at org.apache.openjpa.jdbc.kernel.SQLStoreQuery$SQLExecutor.executeQuery(SQLStoreQuery.java:248) ~[openjpa-jdbc-3.1.0.jar:3.1.0]         at org.apache.openjpa.kernel.QueryImpl.execute(QueryImpl.java:1060) ~[openjpa-kernel-3.1.0.jar:3.1.0]         at org.apache.openjpa.kernel.QueryImpl.execute(QueryImpl.java:912) ~[openjpa-kernel-3.1.0.jar:3.1.0]         at org.apache.openjpa.kernel.QueryImpl.execute(QueryImpl.java:843) ~[openjpa-kernel-3.1.0.jar:3.1.0]         at org.apache.openjpa.kernel.DelegatingQuery.execute(DelegatingQuery.java:601) ~[openjpa-kernel-3.1.0.jar:3.1.0]         at org.apache.openjpa.persistence.QueryImpl.execute(QueryImpl.java:297) ~[openjpa-persistence-3.1.0.jar:3.1.0]         at org.apache.openjpa.persistence.QueryImpl.getResultList(QueryImpl.java:314) ~[openjpa-persistence-3.1.0.jar:3.1.0]         at org.apache.syncope.core.persistence.jpa.dao.AbstractAnyDAO.findDynRealms(AbstractAnyDAO.java:536) ~[syncope-core-persistence-jpa-2.1.5.jar:2.1.5]         at sun.reflect.GeneratedMethodAccessor280.invoke(Unknown Source) ~[?:?]         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_222] 
        at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_222]
        at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:343) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:295) ~[spring-tx-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:98) ~[spring-tx-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.apache.syncope.core.persistence.jpa.spring.DomainTransactionInterceptor.invoke(DomainTransactionInterceptor.java:60) ~[syncope-core-persistence-jpa-2.1.5.jar:2.1.5]         at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE] 
        at com.sun.proxy.$Proxy69.findDynRealms(Unknown Source) ~[?:?]
        at org.apache.syncope.core.provisioning.java.data.UserDataBinderImpl.getUserTO(UserDataBinderImpl.java:611) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at org.apache.syncope.core.provisioning.java.data.UserDataBinderImpl.getUserTO(UserDataBinderImpl.java:655) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at sun.reflect.GeneratedMethodAccessor278.invoke(Unknown Source) ~[?:?]         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_222] 
        at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_222]
        at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:343) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:295) ~[spring-tx-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:98) ~[spring-tx-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.apache.syncope.core.persistence.jpa.spring.DomainTransactionInterceptor.invoke(DomainTransactionInterceptor.java:60) ~[syncope-core-persistence-jpa-2.1.5.jar:2.1.5]         at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE] 
        at com.sun.proxy.$Proxy86.getUserTO(Unknown Source) ~[?:?]
        at org.apache.syncope.core.provisioning.java.pushpull.DefaultUserPullResultHandler.getAnyTO(DefaultUserPullResultHandler.java:62) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at org.apache.syncope.core.provisioning.java.pushpull.DefaultUserPullResultHandler.doCreate(DefaultUserPullResultHandler.java:80) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at org.apache.syncope.core.provisioning.java.pushpull.AbstractPullResultHandler.create(AbstractPullResultHandler.java:272) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at org.apache.syncope.core.provisioning.java.pushpull.AbstractPullResultHandler.provision(AbstractPullResultHandler.java:236) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at org.apache.syncope.core.provisioning.java.pushpull.AbstractPullResultHandler.doHandle(AbstractPullResultHandler.java:816) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at org.apache.syncope.core.provisioning.java.pushpull.AbstractPullResultHandler.handle(AbstractPullResultHandler.java:123) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at sun.reflect.GeneratedMethodAccessor276.invoke(Unknown Source) ~[?:?]         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_222] 
        at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_222]
        at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:343) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:295) ~[spring-tx-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:98) ~[spring-tx-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.apache.syncope.core.persistence.jpa.spring.DomainTransactionInterceptor.invoke(DomainTransactionInterceptor.java:60) ~[syncope-core-persistence-jpa-2.1.5.jar:2.1.5]         at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE] 
        at com.sun.proxy.$Proxy301.handle(Unknown Source) ~[?:?]
        at org.apache.syncope.core.provisioning.java.ConnectorFacadeProxy$1.handle(ConnectorFacadeProxy.java:340) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at org.apache.syncope.core.provisioning.java.ConnectorFacadeProxy$2.handle(ConnectorFacadeProxy.java:464) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at org.identityconnectors.framework.impl.api.StreamHandlerUtil$ObjectStreamHandlerAdapter.handle(StreamHandlerUtil.java:101) ~[connector-framework-internal-1.5.0.1.jar:?]         at org.identityconnectors.framework.impl.api.BufferedResultsProxy.invoke(BufferedResultsProxy.java:262) ~[connector-framework-internal-1.5.0.1.jar:?]         at org.identityconnectors.framework.impl.api.DelegatingTimeoutProxy.invoke(DelegatingTimeoutProxy.java:94) ~[connector-framework-internal-1.5.0.1.jar:?] 
        at com.sun.proxy.$Proxy302.search(Unknown Source) ~[?:?]
        at org.identityconnectors.framework.impl.api.AbstractConnectorFacade.search(AbstractConnectorFacade.java:183) ~[connector-framework-internal-1.5.0.1.jar:?]         at org.apache.syncope.core.provisioning.java.ConnectorFacadeProxy.search(ConnectorFacadeProxy.java:454) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at org.apache.syncope.core.provisioning.java.ConnectorFacadeProxy.filteredReconciliation(ConnectorFacadeProxy.java:331) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at org.apache.syncope.core.provisioning.java.ConnectorFacadeProxy.fullReconciliation(ConnectorFacadeProxy.java:313) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at org.apache.syncope.core.provisioning.java.pushpull.PullJobDelegate.doExecuteProvisioning(PullJobDelegate.java:349) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at org.apache.syncope.core.provisioning.java.pushpull.PullJobDelegate.doExecuteProvisioning(PullJobDelegate.java:67) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at org.apache.syncope.core.provisioning.java.pushpull.AbstractProvisioningJobDelegate.doExecute(AbstractProvisioningJobDelegate.java:553) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at org.apache.syncope.core.provisioning.java.job.AbstractSchedTaskJobDelegate.execute(AbstractSchedTaskJobDelegate.java:122) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_222]         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_222]         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_222] 
        at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_222]
        at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:343) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:295) ~[spring-tx-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:98) ~[spring-tx-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.apache.syncope.core.persistence.jpa.spring.DomainTransactionInterceptor.invoke(DomainTransactionInterceptor.java:60) ~[syncope-core-persistence-jpa-2.1.5.jar:2.1.5]         at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE] 
        at com.sun.proxy.$Proxy295.execute(Unknown Source) ~[?:?]
        at org.apache.syncope.core.provisioning.java.job.TaskJob.lambda$execute$0(TaskJob.java:87) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at org.apache.syncope.core.spring.security.AuthContextUtils.execWithAuthContext(AuthContextUtils.java:117) ~[syncope-core-spring-2.1.5.jar:2.1.5]         at org.apache.syncope.core.provisioning.java.job.TaskJob.execute(TaskJob.java:76) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at org.quartz.core.JobRunShell.run(JobRunShell.java:202) ~[quartz-2.3.1.jar:?]         at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:573) ~[quartz-2.3.1.jar:?] Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: Connection has already been closed. {SELECT dynRealm_id FROM DynRealmMembers WHERE any_id=?} [code=0, state=null]         at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:219) ~[openjpa-lib-3.1.0.jar:3.1.0]         at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:199) ~[openjpa-lib-3.1.0.jar:3.1.0]         at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$000(LoggingConnectionDecorator.java:58) ~[openjpa-lib-3.1.0.jar:3.1.0]         at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection.prepareStatement(LoggingConnectionDecorator.java:252) ~[openjpa-lib-3.1.0.jar:3.1.0]         at org.apache.openjpa.lib.jdbc.DelegatingConnection.prepareStatement(DelegatingConnection.java:138) ~[openjpa-lib-3.1.0.jar:3.1.0]         at org.apache.openjpa.lib.jdbc.ConfiguringConnectionDecorator$ConfiguringConnection.prepareStatement(ConfiguringConnectionDecorator.java:144) ~[openjpa-lib-3.1.0.jar:3.1.0]         at org.apache.openjpa.lib.jdbc.DelegatingConnection.prepareStatement(DelegatingConnection.java:138) ~[openjpa-lib-3.1.0.jar:3.1.0]         at org.apache.openjpa.jdbc.kernel.JDBCStoreManager$RefCountConnection.prepareStatement(JDBCStoreManager.java:1695) ~[openjpa-jdbc-3.1.0.jar:3.1.0]         at org.apache.openjpa.lib.jdbc.DelegatingConnection.prepareStatement(DelegatingConnection.java:127) ~[openjpa-lib-3.1.0.jar:3.1.0]         at org.apache.openjpa.jdbc.sql.SQLBuffer.prepareStatement(SQLBuffer.java:517) ~[openjpa-jdbc-3.1.0.jar:3.1.0]         at org.apache.openjpa.jdbc.sql.SQLBuffer.prepareStatement(SQLBuffer.java:497) ~[openjpa-jdbc-3.1.0.jar:3.1.0]         at org.apache.openjpa.jdbc.sql.SQLBuffer.prepareStatement(SQLBuffer.java:486) ~[openjpa-jdbc-3.1.0.jar:3.1.0]         at org.apache.openjpa.jdbc.kernel.SQLStoreQuery$SQLExecutor.prepareStatement(SQLStoreQuery.java:310) ~[openjpa-jdbc-3.1.0.jar:3.1.0]         at org.apache.openjpa.jdbc.kernel.SQLStoreQuery$SQLExecutor.executeQuery(SQLStoreQuery.java:217) ~[openjpa-jdbc-3.1.0.jar:3.1.0] 
        ... 83 more
03:46:11.353 ERROR org.apache.syncope.core.provisioning.api.job.SchedTaskJobDelegate - While executing provisioning job org.apache.syncope.core.provisioning.java.pushpull.PullJobDelegate 
org.quartz.JobExecutionException: While pulling from connector
        at org.apache.syncope.core.provisioning.java.pushpull.PullJobDelegate.doExecuteProvisioning(PullJobDelegate.java:365) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at org.apache.syncope.core.provisioning.java.pushpull.PullJobDelegate.doExecuteProvisioning(PullJobDelegate.java:67) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at org.apache.syncope.core.provisioning.java.pushpull.AbstractProvisioningJobDelegate.doExecute(AbstractProvisioningJobDelegate.java:553) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at org.apache.syncope.core.provisioning.java.job.AbstractSchedTaskJobDelegate.execute(AbstractSchedTaskJobDelegate.java:122) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_222]         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_222]         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_222] 
        at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_222]
        at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:343) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:295) ~[spring-tx-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:98) ~[spring-tx-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.apache.syncope.core.persistence.jpa.spring.DomainTransactionInterceptor.invoke(DomainTransactionInterceptor.java:60) ~[syncope-core-persistence-jpa-2.1.5.jar:2.1.5]         at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE] 
        at com.sun.proxy.$Proxy295.execute(Unknown Source) ~[?:?]
        at org.apache.syncope.core.provisioning.java.job.TaskJob.lambda$execute$0(TaskJob.java:87) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at org.apache.syncope.core.spring.security.AuthContextUtils.execWithAuthContext(AuthContextUtils.java:117) ~[syncope-core-spring-2.1.5.jar:2.1.5]         at org.apache.syncope.core.provisioning.java.job.TaskJob.execute(TaskJob.java:76) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at org.quartz.core.JobRunShell.run(JobRunShell.java:202) ~[quartz-2.3.1.jar:?]         at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:573) ~[quartz-2.3.1.jar:?] Caused by: org.apache.openjpa.persistence.PersistenceException: Connection has already been closed. {SELECT t0.id, t0.active, t0.recipientAttrName, t0.recipientsFIQL, t1.id, t1.body, t1.engine, t1.type, t0.selfAsRecipient, t0.sender, t0.subject, t2.id, t2.htmlTemplate, t2.textTemplate, t0.traceLevel FROM Notification t0 LEFT OUTER JOIN Implementation t1 ON t0.RECIPIENTSPROVIDER_ID = t1.id INNER JOIN MailTemplate t2 ON t0.template_id = t2.id} [code=0, state=null]         at org.apache.openjpa.jdbc.sql.DBDictionary.narrow(DBDictionary.java:5250) ~[openjpa-jdbc-3.1.0.jar:3.1.0]         at org.apache.openjpa.jdbc.sql.DBDictionary.newStoreException(DBDictionary.java:5210) ~[openjpa-jdbc-3.1.0.jar:3.1.0]         at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:134) ~[openjpa-jdbc-3.1.0.jar:3.1.0]         at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:115) ~[openjpa-jdbc-3.1.0.jar:3.1.0]         at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:67) ~[openjpa-jdbc-3.1.0.jar:3.1.0]         at org.apache.openjpa.jdbc.kernel.SelectResultObjectProvider.handleCheckedException(SelectResultObjectProvider.java:162) ~[openjpa-jdbc-3.1.0.jar:3.1.0]         at org.apache.openjpa.datacache.QueryCacheStoreQuery$CachingResultObjectProvider.handleCheckedException(QueryCacheStoreQuery.java:775) ~[openjpa-kernel-3.1.0.jar:3.1.0]         at org.apache.openjpa.kernel.QueryImpl$PackingResultObjectProvider.handleCheckedException(QueryImpl.java:2231) ~[openjpa-kernel-3.1.0.jar:3.1.0]         at org.apache.openjpa.lib.rop.EagerResultList.<init>(EagerResultList.java:42) ~[openjpa-lib-3.1.0.jar:3.1.0]         at org.apache.openjpa.kernel.QueryImpl.toResult(QueryImpl.java:1311) ~[openjpa-kernel-3.1.0.jar:3.1.0]         at org.apache.openjpa.kernel.QueryImpl.execute(QueryImpl.java:1062) ~[openjpa-kernel-3.1.0.jar:3.1.0]         at org.apache.openjpa.kernel.QueryImpl.execute(QueryImpl.java:912) ~[openjpa-kernel-3.1.0.jar:3.1.0]         at org.apache.openjpa.kernel.QueryImpl.execute(QueryImpl.java:843) ~[openjpa-kernel-3.1.0.jar:3.1.0]         at org.apache.openjpa.kernel.DelegatingQuery.execute(DelegatingQuery.java:601) ~[openjpa-kernel-3.1.0.jar:3.1.0]         at org.apache.openjpa.persistence.QueryImpl.execute(QueryImpl.java:297) ~[openjpa-persistence-3.1.0.jar:3.1.0]         at org.apache.openjpa.persistence.QueryImpl.getResultList(QueryImpl.java:314) ~[openjpa-persistence-3.1.0.jar:3.1.0]         at org.apache.syncope.core.persistence.jpa.dao.JPANotificationDAO.findAll(JPANotificationDAO.java:74) ~[syncope-core-persistence-jpa-2.1.5.jar:2.1.5]         at sun.reflect.GeneratedMethodAccessor249.invoke(Unknown Source) ~[?:?]         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_222] 
        at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_222]
        at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:343) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:295) ~[spring-tx-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:98) ~[spring-tx-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.apache.syncope.core.persistence.jpa.spring.DomainTransactionInterceptor.invoke(DomainTransactionInterceptor.java:60) ~[syncope-core-persistence-jpa-2.1.5.jar:2.1.5]         at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE] 
        at com.sun.proxy.$Proxy89.findAll(Unknown Source) ~[?:?]
        at org.apache.syncope.core.provisioning.java.notification.DefaultNotificationManager.createTasks(DefaultNotificationManager.java:335) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at sun.reflect.GeneratedMethodAccessor275.invoke(Unknown Source) ~[?:?]         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_222] 
        at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_222]
        at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:343) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:295) ~[spring-tx-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:98) ~[spring-tx-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.apache.syncope.core.persistence.jpa.spring.DomainTransactionInterceptor.invoke(DomainTransactionInterceptor.java:60) ~[syncope-core-persistence-jpa-2.1.5.jar:2.1.5]         at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE] 
        at com.sun.proxy.$Proxy92.createTasks(Unknown Source) ~[?:?]
        at org.apache.syncope.core.provisioning.java.pushpull.AbstractPullResultHandler.finalize(AbstractPullResultHandler.java:904) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at org.apache.syncope.core.provisioning.java.pushpull.AbstractPullResultHandler.create(AbstractPullResultHandler.java:312) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at org.apache.syncope.core.provisioning.java.pushpull.AbstractPullResultHandler.provision(AbstractPullResultHandler.java:236) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at org.apache.syncope.core.provisioning.java.pushpull.AbstractPullResultHandler.doHandle(AbstractPullResultHandler.java:816) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at org.apache.syncope.core.provisioning.java.pushpull.AbstractPullResultHandler.handle(AbstractPullResultHandler.java:123) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at sun.reflect.GeneratedMethodAccessor276.invoke(Unknown Source) ~[?:?]         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_222] 
        at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_222]
        at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:343) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:295) ~[spring-tx-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:98) ~[spring-tx-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.apache.syncope.core.persistence.jpa.spring.DomainTransactionInterceptor.invoke(DomainTransactionInterceptor.java:60) ~[syncope-core-persistence-jpa-2.1.5.jar:2.1.5]         at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE] 
        at com.sun.proxy.$Proxy301.handle(Unknown Source) ~[?:?]
        at org.apache.syncope.core.provisioning.java.ConnectorFacadeProxy$1.handle(ConnectorFacadeProxy.java:340) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at org.apache.syncope.core.provisioning.java.ConnectorFacadeProxy$2.handle(ConnectorFacadeProxy.java:464) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at org.identityconnectors.framework.impl.api.StreamHandlerUtil$ObjectStreamHandlerAdapter.handle(StreamHandlerUtil.java:101) ~[connector-framework-internal-1.5.0.1.jar:?]         at org.identityconnectors.framework.impl.api.BufferedResultsProxy.invoke(BufferedResultsProxy.java:262) ~[connector-framework-internal-1.5.0.1.jar:?]         at org.identityconnectors.framework.impl.api.DelegatingTimeoutProxy.invoke(DelegatingTimeoutProxy.java:94) ~[connector-framework-internal-1.5.0.1.jar:?] 
        at com.sun.proxy.$Proxy302.search(Unknown Source) ~[?:?]
        at org.identityconnectors.framework.impl.api.AbstractConnectorFacade.search(AbstractConnectorFacade.java:183) ~[connector-framework-internal-1.5.0.1.jar:?]         at org.apache.syncope.core.provisioning.java.ConnectorFacadeProxy.search(ConnectorFacadeProxy.java:454) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at org.apache.syncope.core.provisioning.java.ConnectorFacadeProxy.filteredReconciliation(ConnectorFacadeProxy.java:331) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at org.apache.syncope.core.provisioning.java.ConnectorFacadeProxy.fullReconciliation(ConnectorFacadeProxy.java:313) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at org.apache.syncope.core.provisioning.java.pushpull.PullJobDelegate.doExecuteProvisioning(PullJobDelegate.java:349) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5] 
        ... 21 more
Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: Connection has already been closed. {SELECT t0.id, t0.active, t0.recipientAttrName, t0.recipientsFIQL, t1.id, t1.body, t1.engine, t1.type, t0.selfAsRecipient, t0.sender, t0.subject, t2.id, t2.htmlTemplate, t2.textTemplate, t0.traceLevel FROM Notification t0 LEFT OUTER JOIN Implementation t1 ON t0.RECIPIENTSPROVIDER_ID = t1.id INNER JOIN MailTemplate t2 ON t0.template_id = t2.id} [code=0, state=null]         at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:219) ~[openjpa-lib-3.1.0.jar:3.1.0]         at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:199) ~[openjpa-lib-3.1.0.jar:3.1.0]         at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$000(LoggingConnectionDecorator.java:58) ~[openjpa-lib-3.1.0.jar:3.1.0]         at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection.prepareStatement(LoggingConnectionDecorator.java:252) ~[openjpa-lib-3.1.0.jar:3.1.0]         at org.apache.openjpa.lib.jdbc.DelegatingConnection.prepareStatement(DelegatingConnection.java:138) ~[openjpa-lib-3.1.0.jar:3.1.0]         at org.apache.openjpa.lib.jdbc.ConfiguringConnectionDecorator$ConfiguringConnection.prepareStatement(ConfiguringConnectionDecorator.java:144) ~[openjpa-lib-3.1.0.jar:3.1.0]         at org.apache.openjpa.lib.jdbc.DelegatingConnection.prepareStatement(DelegatingConnection.java:138) ~[openjpa-lib-3.1.0.jar:3.1.0]         at org.apache.openjpa.jdbc.kernel.JDBCStoreManager$RefCountConnection.prepareStatement(JDBCStoreManager.java:1695) ~[openjpa-jdbc-3.1.0.jar:3.1.0]         at org.apache.openjpa.lib.jdbc.DelegatingConnection.prepareStatement(DelegatingConnection.java:127) ~[openjpa-lib-3.1.0.jar:3.1.0]         at org.apache.openjpa.jdbc.sql.SQLBuffer.prepareStatement(SQLBuffer.java:517) ~[openjpa-jdbc-3.1.0.jar:3.1.0]         at org.apache.openjpa.jdbc.sql.SQLBuffer.prepareStatement(SQLBuffer.java:497) ~[openjpa-jdbc-3.1.0.jar:3.1.0]         at org.apache.openjpa.jdbc.sql.SelectImpl.prepareStatement(SelectImpl.java:510) ~[openjpa-jdbc-3.1.0.jar:3.1.0]         at org.apache.openjpa.jdbc.sql.SelectImpl.execute(SelectImpl.java:451) ~[openjpa-jdbc-3.1.0.jar:3.1.0]         at org.apache.openjpa.jdbc.sql.SelectImpl.execute(SelectImpl.java:422) ~[openjpa-jdbc-3.1.0.jar:3.1.0]         at org.apache.openjpa.jdbc.sql.LogicalUnion$UnionSelect.execute(LogicalUnion.java:472) ~[openjpa-jdbc-3.1.0.jar:3.1.0]         at org.apache.openjpa.jdbc.sql.LogicalUnion.execute(LogicalUnion.java:254) ~[openjpa-jdbc-3.1.0.jar:3.1.0]         at org.apache.openjpa.jdbc.sql.LogicalUnion.execute(LogicalUnion.java:243) ~[openjpa-jdbc-3.1.0.jar:3.1.0]         at org.apache.openjpa.jdbc.kernel.SelectResultObjectProvider.open(SelectResultObjectProvider.java:95) ~[openjpa-jdbc-3.1.0.jar:3.1.0]         at org.apache.openjpa.datacache.QueryCacheStoreQuery$CachingResultObjectProvider.open(QueryCacheStoreQuery.java:711) ~[openjpa-kernel-3.1.0.jar:3.1.0]         at org.apache.openjpa.kernel.QueryImpl$PackingResultObjectProvider.open(QueryImpl.java:2183) ~[openjpa-kernel-3.1.0.jar:3.1.0]         at org.apache.openjpa.lib.rop.EagerResultList.<init>(EagerResultList.java:36) ~[openjpa-lib-3.1.0.jar:3.1.0]         at org.apache.openjpa.kernel.QueryImpl.toResult(QueryImpl.java:1311) ~[openjpa-kernel-3.1.0.jar:3.1.0]         at org.apache.openjpa.kernel.QueryImpl.execute(QueryImpl.java:1062) ~[openjpa-kernel-3.1.0.jar:3.1.0]         at org.apache.openjpa.kernel.QueryImpl.execute(QueryImpl.java:912) ~[openjpa-kernel-3.1.0.jar:3.1.0]         at org.apache.openjpa.kernel.QueryImpl.execute(QueryImpl.java:843) ~[openjpa-kernel-3.1.0.jar:3.1.0]         at org.apache.openjpa.kernel.DelegatingQuery.execute(DelegatingQuery.java:601) ~[openjpa-kernel-3.1.0.jar:3.1.0]         at org.apache.openjpa.persistence.QueryImpl.execute(QueryImpl.java:297) ~[openjpa-persistence-3.1.0.jar:3.1.0]         at org.apache.openjpa.persistence.QueryImpl.getResultList(QueryImpl.java:314) ~[openjpa-persistence-3.1.0.jar:3.1.0]         at org.apache.syncope.core.persistence.jpa.dao.JPANotificationDAO.findAll(JPANotificationDAO.java:74) ~[syncope-core-persistence-jpa-2.1.5.jar:2.1.5]         at sun.reflect.GeneratedMethodAccessor249.invoke(Unknown Source) ~[?:?]         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_222] 
        at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_222]
        at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:343) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:295) ~[spring-tx-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:98) ~[spring-tx-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.apache.syncope.core.persistence.jpa.spring.DomainTransactionInterceptor.invoke(DomainTransactionInterceptor.java:60) ~[syncope-core-persistence-jpa-2.1.5.jar:2.1.5]         at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE] 
        at com.sun.proxy.$Proxy89.findAll(Unknown Source) ~[?:?]
        at org.apache.syncope.core.provisioning.java.notification.DefaultNotificationManager.createTasks(DefaultNotificationManager.java:335) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at sun.reflect.GeneratedMethodAccessor275.invoke(Unknown Source) ~[?:?]         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_222] 
        at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_222]
        at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:343) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:295) ~[spring-tx-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:98) ~[spring-tx-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.apache.syncope.core.persistence.jpa.spring.DomainTransactionInterceptor.invoke(DomainTransactionInterceptor.java:60) ~[syncope-core-persistence-jpa-2.1.5.jar:2.1.5]         at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE] 
        at com.sun.proxy.$Proxy92.createTasks(Unknown Source) ~[?:?]
        at org.apache.syncope.core.provisioning.java.pushpull.AbstractPullResultHandler.finalize(AbstractPullResultHandler.java:904) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at org.apache.syncope.core.provisioning.java.pushpull.AbstractPullResultHandler.create(AbstractPullResultHandler.java:312) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at org.apache.syncope.core.provisioning.java.pushpull.AbstractPullResultHandler.provision(AbstractPullResultHandler.java:236) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at org.apache.syncope.core.provisioning.java.pushpull.AbstractPullResultHandler.doHandle(AbstractPullResultHandler.java:816) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at org.apache.syncope.core.provisioning.java.pushpull.AbstractPullResultHandler.handle(AbstractPullResultHandler.java:123) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at sun.reflect.GeneratedMethodAccessor276.invoke(Unknown Source) ~[?:?]         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_222] 
        at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_222]
        at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:343) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:295) ~[spring-tx-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:98) ~[spring-tx-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.apache.syncope.core.persistence.jpa.spring.DomainTransactionInterceptor.invoke(DomainTransactionInterceptor.java:60) ~[syncope-core-persistence-jpa-2.1.5.jar:2.1.5]         at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE] 
        at com.sun.proxy.$Proxy301.handle(Unknown Source) ~[?:?]
        at org.apache.syncope.core.provisioning.java.ConnectorFacadeProxy$1.handle(ConnectorFacadeProxy.java:340) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at org.apache.syncope.core.provisioning.java.ConnectorFacadeProxy$2.handle(ConnectorFacadeProxy.java:464) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at org.identityconnectors.framework.impl.api.StreamHandlerUtil$ObjectStreamHandlerAdapter.handle(StreamHandlerUtil.java:101) ~[connector-framework-internal-1.5.0.1.jar:?]         at org.identityconnectors.framework.impl.api.BufferedResultsProxy.invoke(BufferedResultsProxy.java:262) ~[connector-framework-internal-1.5.0.1.jar:?]         at org.identityconnectors.framework.impl.api.DelegatingTimeoutProxy.invoke(DelegatingTimeoutProxy.java:94) ~[connector-framework-internal-1.5.0.1.jar:?] 
        at com.sun.proxy.$Proxy302.search(Unknown Source) ~[?:?]
        at org.identityconnectors.framework.impl.api.AbstractConnectorFacade.search(AbstractConnectorFacade.java:183) ~[connector-framework-internal-1.5.0.1.jar:?]         at org.apache.syncope.core.provisioning.java.ConnectorFacadeProxy.search(ConnectorFacadeProxy.java:454) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at org.apache.syncope.core.provisioning.java.ConnectorFacadeProxy.filteredReconciliation(ConnectorFacadeProxy.java:331) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at org.apache.syncope.core.provisioning.java.ConnectorFacadeProxy.fullReconciliation(ConnectorFacadeProxy.java:313) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at org.apache.syncope.core.provisioning.java.pushpull.PullJobDelegate.doExecuteProvisioning(PullJobDelegate.java:349) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5] 
        ... 21 more
03:46:11.353 ERROR org.apache.syncope.core.provisioning.api.job.SchedTaskJobDelegate - While executing task 6cef6cfd-4c73-4224-af6c-fd4c733224c7 
org.quartz.JobExecutionException: While pulling from connector
        at org.apache.syncope.core.provisioning.java.pushpull.PullJobDelegate.doExecuteProvisioning(PullJobDelegate.java:365) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at org.apache.syncope.core.provisioning.java.pushpull.PullJobDelegate.doExecuteProvisioning(PullJobDelegate.java:67) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at org.apache.syncope.core.provisioning.java.pushpull.AbstractProvisioningJobDelegate.doExecute(AbstractProvisioningJobDelegate.java:553) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at org.apache.syncope.core.provisioning.java.job.AbstractSchedTaskJobDelegate.execute(AbstractSchedTaskJobDelegate.java:122) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_222]         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_222]         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_222] 
        at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_222]
        at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:343) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:295) ~[spring-tx-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:98) ~[spring-tx-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.apache.syncope.core.persistence.jpa.spring.DomainTransactionInterceptor.invoke(DomainTransactionInterceptor.java:60) ~[syncope-core-persistence-jpa-2.1.5.jar:2.1.5]         at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE] 
        at com.sun.proxy.$Proxy295.execute(Unknown Source) ~[?:?]
        at org.apache.syncope.core.provisioning.java.job.TaskJob.lambda$execute$0(TaskJob.java:87) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at org.apache.syncope.core.spring.security.AuthContextUtils.execWithAuthContext(AuthContextUtils.java:117) ~[syncope-core-spring-2.1.5.jar:2.1.5]         at org.apache.syncope.core.provisioning.java.job.TaskJob.execute(TaskJob.java:76) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at org.quartz.core.JobRunShell.run(JobRunShell.java:202) ~[quartz-2.3.1.jar:?]         at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:573) ~[quartz-2.3.1.jar:?] Caused by: org.apache.openjpa.persistence.PersistenceException: Connection has already been closed. {SELECT t0.id, t0.active, t0.recipientAttrName, t0.recipientsFIQL, t1.id, t1.body, t1.engine, t1.type, t0.selfAsRecipient, t0.sender, t0.subject, t2.id, t2.htmlTemplate, t2.textTemplate, t0.traceLevel FROM Notification t0 LEFT OUTER JOIN Implementation t1 ON t0.RECIPIENTSPROVIDER_ID = t1.id INNER JOIN MailTemplate t2 ON t0.template_id = t2.id} [code=0, state=null]         at org.apache.openjpa.jdbc.sql.DBDictionary.narrow(DBDictionary.java:5250) ~[openjpa-jdbc-3.1.0.jar:3.1.0]         at org.apache.openjpa.jdbc.sql.DBDictionary.newStoreException(DBDictionary.java:5210) ~[openjpa-jdbc-3.1.0.jar:3.1.0]         at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:134) ~[openjpa-jdbc-3.1.0.jar:3.1.0]         at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:115) ~[openjpa-jdbc-3.1.0.jar:3.1.0]         at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:67) ~[openjpa-jdbc-3.1.0.jar:3.1.0]         at org.apache.openjpa.jdbc.kernel.SelectResultObjectProvider.handleCheckedException(SelectResultObjectProvider.java:162) ~[openjpa-jdbc-3.1.0.jar:3.1.0]         at org.apache.openjpa.datacache.QueryCacheStoreQuery$CachingResultObjectProvider.handleCheckedException(QueryCacheStoreQuery.java:775) ~[openjpa-kernel-3.1.0.jar:3.1.0]         at org.apache.openjpa.kernel.QueryImpl$PackingResultObjectProvider.handleCheckedException(QueryImpl.java:2231) ~[openjpa-kernel-3.1.0.jar:3.1.0]         at org.apache.openjpa.lib.rop.EagerResultList.<init>(EagerResultList.java:42) ~[openjpa-lib-3.1.0.jar:3.1.0]         at org.apache.openjpa.kernel.QueryImpl.toResult(QueryImpl.java:1311) ~[openjpa-kernel-3.1.0.jar:3.1.0]         at org.apache.openjpa.kernel.QueryImpl.execute(QueryImpl.java:1062) ~[openjpa-kernel-3.1.0.jar:3.1.0]         at org.apache.openjpa.kernel.QueryImpl.execute(QueryImpl.java:912) ~[openjpa-kernel-3.1.0.jar:3.1.0]         at org.apache.openjpa.kernel.QueryImpl.execute(QueryImpl.java:843) ~[openjpa-kernel-3.1.0.jar:3.1.0]         at org.apache.openjpa.kernel.DelegatingQuery.execute(DelegatingQuery.java:601) ~[openjpa-kernel-3.1.0.jar:3.1.0]         at org.apache.openjpa.persistence.QueryImpl.execute(QueryImpl.java:297) ~[openjpa-persistence-3.1.0.jar:3.1.0]         at org.apache.openjpa.persistence.QueryImpl.getResultList(QueryImpl.java:314) ~[openjpa-persistence-3.1.0.jar:3.1.0]         at org.apache.syncope.core.persistence.jpa.dao.JPANotificationDAO.findAll(JPANotificationDAO.java:74) ~[syncope-core-persistence-jpa-2.1.5.jar:2.1.5]         at sun.reflect.GeneratedMethodAccessor249.invoke(Unknown Source) ~[?:?]         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_222] 
        at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_222]
        at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:343) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:295) ~[spring-tx-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:98) ~[spring-tx-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.apache.syncope.core.persistence.jpa.spring.DomainTransactionInterceptor.invoke(DomainTransactionInterceptor.java:60) ~[syncope-core-persistence-jpa-2.1.5.jar:2.1.5]         at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE] 
        at com.sun.proxy.$Proxy89.findAll(Unknown Source) ~[?:?]
        at org.apache.syncope.core.provisioning.java.notification.DefaultNotificationManager.createTasks(DefaultNotificationManager.java:335) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at sun.reflect.GeneratedMethodAccessor275.invoke(Unknown Source) ~[?:?]         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_222] 
        at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_222]
        at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:343) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:295) ~[spring-tx-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:98) ~[spring-tx-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.apache.syncope.core.persistence.jpa.spring.DomainTransactionInterceptor.invoke(DomainTransactionInterceptor.java:60) ~[syncope-core-persistence-jpa-2.1.5.jar:2.1.5]         at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE] 
        at com.sun.proxy.$Proxy92.createTasks(Unknown Source) ~[?:?]
        at org.apache.syncope.core.provisioning.java.pushpull.AbstractPullResultHandler.finalize(AbstractPullResultHandler.java:904) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at org.apache.syncope.core.provisioning.java.pushpull.AbstractPullResultHandler.create(AbstractPullResultHandler.java:312) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at org.apache.syncope.core.provisioning.java.pushpull.AbstractPullResultHandler.provision(AbstractPullResultHandler.java:236) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at org.apache.syncope.core.provisioning.java.pushpull.AbstractPullResultHandler.doHandle(AbstractPullResultHandler.java:816) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at org.apache.syncope.core.provisioning.java.pushpull.AbstractPullResultHandler.handle(AbstractPullResultHandler.java:123) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at sun.reflect.GeneratedMethodAccessor276.invoke(Unknown Source) ~[?:?]         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_222] 
        at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_222]
        at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:343) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:295) ~[spring-tx-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:98) ~[spring-tx-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.apache.syncope.core.persistence.jpa.spring.DomainTransactionInterceptor.invoke(DomainTransactionInterceptor.java:60) ~[syncope-core-persistence-jpa-2.1.5.jar:2.1.5]         at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE]         at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) ~[spring-aop-5.1.9.RELEASE.jar:5.1.9.RELEASE] 
        at com.sun.proxy.$Proxy301.handle(Unknown Source) ~[?:?]
        at org.apache.syncope.core.provisioning.java.ConnectorFacadeProxy$1.handle(ConnectorFacadeProxy.java:340) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at org.apache.syncope.core.provisioning.java.ConnectorFacadeProxy$2.handle(ConnectorFacadeProxy.java:464) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at org.identityconnectors.framework.impl.api.StreamHandlerUtil$ObjectStreamHandlerAdapter.handle(StreamHandlerUtil.java:101) ~[connector-framework-internal-1.5.0.1.jar:?]         at org.identityconnectors.framework.impl.api.BufferedResultsProxy.invoke(BufferedResultsProxy.java:262) ~[connector-framework-internal-1.5.0.1.jar:?]         at org.identityconnectors.framework.impl.api.DelegatingTimeoutProxy.invoke(DelegatingTimeoutProxy.java:94) ~[connector-framework-internal-1.5.0.1.jar:?] 
        at com.sun.proxy.$Proxy302.search(Unknown Source) ~[?:?]
        at org.identityconnectors.framework.impl.api.AbstractConnectorFacade.search(AbstractConnectorFacade.java:183) ~[connector-framework-internal-1.5.0.1.jar:?]         at org.apache.syncope.core.provisioning.java.ConnectorFacadeProxy.search(ConnectorFacadeProxy.java:454) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at org.apache.syncope.core.provisioning.java.ConnectorFacadeProxy.filteredReconciliation(ConnectorFacadeProxy.java:331) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at org.apache.syncope.core.provisioning.java.ConnectorFacadeProxy.fullReconciliation(ConnectorFacadeProxy.java:313) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5]         at org.apache.syncope.core.provisioning.java.pushpull.PullJobDelegate.doExecuteProvisioning(PullJobDelegate.java:349) ~[syncope-core-provisioning-java-2.1.5.jar:2.1.5] 
        ... 21 more
FYI, the users in the CSV started with "Auid00001", so it started having the problem on the 290th user in the CSV.
Has someone encountered these problems?  Are there configuration changes that we can make to get it to work?  FYI, if we can proceed, the user base that we will be wanting to manage with Syncope will be in the > 50K user range, so it's a bit surprising encountering problems with such a small set of users? 

Jim


--
Dott. Andrea Patricelli
Tel. +39 3204524292

Engineer @ Tirasa S.r.l.
Viale Vittoria Colonna 97 - 65127 Pescara
Tel +39 0859116307 / FAX +39 0859111173
http://www.tirasa.net

Apache Syncope PMC Member

Reply via email to