Hi Azeez, We are currently doing testing in carbon 4.3.0 with the latest hazelcast 3.2.6 upgrade. And when shutting down a server using (ctrl +c ) following error occurred. This was reported earlier also here [1] in carbon 4.2.0.
Exception in thread "Cluster [wso2.as.domain] coordinator elector thread" com.hazelcast.core.HazelcastInstanceNotActiveException: Hazelcast instance is not active! at com.hazelcast.spi.impl.BasicOperationService.shutdown(BasicOperationService.java:749) at com.hazelcast.spi.impl.NodeEngineImpl.shutdown(NodeEngineImpl.java:347) at com.hazelcast.instance.Node.shutdown(Node.java:420) at com.hazelcast.instance.Node$NodeShutdownHookThread.run(Node.java:507) at ------ End remote and begin local stack-trace ------.(Unknown Source) at com.hazelcast.spi.impl.BasicInvocation$InvocationFuture.resolveResponse(BasicInvocation.java:869) at com.hazelcast.spi.impl.BasicInvocation$InvocationFuture.resolveResponseOrThrowException(BasicInvocation.java:802) at com.hazelcast.spi.impl.BasicInvocation$InvocationFuture.get(BasicInvocation.java:698) at com.hazelcast.spi.impl.BasicInvocation$InvocationFuture.get(BasicInvocation.java:676) at com.hazelcast.spi.impl.BasicInvocation$InvocationFuture.getSafely(BasicInvocation.java:689) at com.hazelcast.concurrent.lock.LockProxySupport.lock(LockProxySupport.java:80) at com.hazelcast.concurrent.lock.LockProxySupport.lock(LockProxySupport.java:74) at com.hazelcast.concurrent.lock.LockProxy.lock(LockProxy.java:70) at org.wso2.carbon.core.clustering.hazelcast.HazelcastClusteringAgent$2.run(HazelcastClusteringAgent.java:228) Any idea on how to overcome this error?. I looked at the HazelcastClusteringAgent code and AFAIU coordinatorElectorThread is waiting for acquire the lock and the hazelcast instance is not valid at this point since the shutdown is triggered. I tried using the *hazelcast.shutdownhook.enabled=false* property and it ended up with the following error. Exception in thread "Cluster [wso2.as.domain] coordinator elector thread" com.hazelcast.core.HazelcastInstanceNotActiveException: Hazelcast instance is not active! at com.hazelcast.spi.impl.BasicOperationService.shutdown(BasicOperationService.java:749) at com.hazelcast.spi.impl.NodeEngineImpl.shutdown(NodeEngineImpl.java:347) at com.hazelcast.instance.Node.shutdown(Node.java:420) at com.hazelcast.instance.LifecycleServiceImpl.shutdown(LifecycleServiceImpl.java:79) at com.hazelcast.instance.HazelcastInstanceFactory.shutdownAll(HazelcastInstanceFactory.java:213) at com.hazelcast.core.Hazelcast.shutdownAll(Hazelcast.java:41) at org.wso2.carbon.core.clustering.hazelcast.HazelcastClusteringAgent.stop(HazelcastClusteringAgent.java:347) at org.apache.axis2.engine.AxisConfiguration.cleanup(AxisConfiguration.java:1462) at org.apache.axis2.context.ConfigurationContext.terminate(ConfigurationContext.java:788) at org.apache.axis2.transport.http.AxisServlet.destroy(AxisServlet.java:528) at org.eclipse.equinox.http.servlet.internal.ServletRegistration.destroy(ServletRegistration.java:38) at org.eclipse.equinox.http.servlet.internal.ProxyServlet.unregister(ProxyServlet.java:153) at org.eclipse.equinox.http.servlet.internal.HttpServiceImpl.unregister(HttpServiceImpl.java:88) at org.wso2.carbon.core.init.CarbonServerManager.stop(CarbonServerManager.java:932) at org.wso2.carbon.core.internal.CarbonCoreServiceComponent.deactivate(CarbonCoreServiceComponent.java:102) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.eclipse.equinox.internal.ds.model.ServiceComponent.deactivate(ServiceComponent.java:387) at org.eclipse.equinox.internal.ds.model.ServiceComponentProp.deactivate(ServiceComponentProp.java:161) at org.eclipse.equinox.internal.ds.model.ServiceComponentProp.dispose(ServiceComponentProp.java:389) at org.eclipse.equinox.internal.ds.model.ServiceComponentProp.dispose(ServiceComponentProp.java:102) at org.eclipse.equinox.internal.ds.InstanceProcess.disposeInstances(InstanceProcess.java:344) at org.eclipse.equinox.internal.ds.InstanceProcess.disposeInstances(InstanceProcess.java:306) at org.eclipse.equinox.internal.ds.Resolver.getEligible(Resolver.java:368) at org.eclipse.equinox.internal.ds.SCRManager.serviceChanged(SCRManager.java:222) at org.eclipse.osgi.internal.serviceregistry.FilteredServiceListener.serviceChanged(FilteredServiceListener.java:107) at org.eclipse.osgi.framework.internal.core.BundleContextImpl.dispatchEvent(BundleContextImpl.java:861) at org.eclipse.osgi.framework.eventmgr.EventManager.dispatchEvent(EventManager.java:230) at org.eclipse.osgi.framework.eventmgr.ListenerQueue.dispatchEventSynchronous(ListenerQueue.java:148) at org.eclipse.osgi.internal.serviceregistry.ServiceRegistry.publishServiceEventPrivileged(ServiceRegistry.java:819) at org.eclipse.osgi.internal.serviceregistry.ServiceRegistry.publishServiceEvent(ServiceRegistry.java:771) at org.eclipse.osgi.internal.serviceregistry.ServiceRegistrationImpl.unregister(ServiceRegistrationImpl.java:225) at org.eclipse.equinox.http.servlet.internal.Activator.removeProxyServlet(Activator.java:87) at org.eclipse.equinox.http.servlet.internal.ProxyServlet.destroy(ProxyServlet.java:44) at org.wso2.carbon.tomcat.ext.servlet.DelegationServlet.destroy(DelegationServlet.java:43) at org.apache.catalina.core.StandardWrapper.unload(StandardWrapper.java:1481) at org.apache.catalina.core.StandardWrapper.stopInternal(StandardWrapper.java:1842) at org.apache.catalina.util.LifecycleBase.stop(LifecycleBase.java:232) at org.apache.catalina.core.StandardContext.stopInternal(StandardContext.java:5647) at org.apache.catalina.util.LifecycleBase.stop(LifecycleBase.java:232) at org.apache.catalina.core.ContainerBase$StopChild.call(ContainerBase.java:1575) at org.apache.catalina.core.ContainerBase$StopChild.call(ContainerBase.java:1564) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) at ------ End remote and begin local stack-trace ------.(Unknown Source) at com.hazelcast.spi.impl.BasicInvocation$InvocationFuture.resolveResponse(BasicInvocation.java:869) at com.hazelcast.spi.impl.BasicInvocation$InvocationFuture.resolveResponseOrThrowException(BasicInvocation.java:802) at com.hazelcast.spi.impl.BasicInvocation$InvocationFuture.get(BasicInvocation.java:698) at com.hazelcast.spi.impl.BasicInvocation$InvocationFuture.get(BasicInvocation.java:676) at com.hazelcast.spi.impl.BasicInvocation$InvocationFuture.getSafely(BasicInvocation.java:689) at com.hazelcast.concurrent.lock.LockProxySupport.lock(LockProxySupport.java:80) at com.hazelcast.concurrent.lock.LockProxySupport.lock(LockProxySupport.java:74) at com.hazelcast.concurrent.lock.LockProxy.lock(LockProxy.java:70) at org.wso2.carbon.core.clustering.hazelcast.HazelcastClusteringAgent$2.run(HazelcastClusteringAgent.java:228) [1]. https://wso2.org/jira/browse/CARBON-14887 Regards, Aruna -- *Aruna Sujith Karunarathna* | Software Engineer WSO2, Inc | lean. enterprise. middleware. #20, Palm Grove, Colombo 03, Sri Lanka Mobile: +94 71 9040362 | Work: +94 112145345 Email: [email protected] | Web: www.wso2.com
_______________________________________________ Dev mailing list [email protected] http://wso2.org/cgi-bin/mailman/listinfo/dev
