[
https://issues.apache.org/jira/browse/STRATOS-941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14201696#comment-14201696
]
Udara Liyanage commented on STRATOS-941:
----------------------------------------
Another instance
[2014-11-07 12:21:41,874] INFO
{org.apache.stratos.autoscaler.applications.topic.ApplicationBuilder} -
Un-deploying the [application] mysql-only-appby marking it as terminating..
[2014-11-07 12:21:41,875] INFO
{org.apache.stratos.autoscaler.applications.topic.ApplicationBuilder} -
Applicationmysql-only-app updated as terminating
[2014-11-07 12:21:41,875] INFO
{org.apache.stratos.autoscaler.monitor.application.ApplicationMonitor} -
[ApplicationMonitor] mysql-only-app state changes from Created to Terminating
[2014-11-07 12:21:41,876] INFO
{org.apache.stratos.autoscaler.event.publisher.ClusterStatusEventPublisher} -
Publishing Cluster Terminating event for [application]: null [cluster]:
mymysql.mysql.domain
[2014-11-07 12:21:41,888] INFO
{org.apache.stratos.messaging.domain.topology.lifecycle.LifeCycleStateManager}
- Topology element [ mymysql.mysql.domain ]'s life Cycle State changed from [
Created ] to [ Terminating ]
[2014-11-07 12:21:41,896] INFO
{org.apache.stratos.autoscaler.applications.topic.ApplicationsEventPublisher} -
Publishing Application terminated event for [application]: mysql-only-app
[2014-11-07 12:21:41,911] ERROR
{org.apache.stratos.messaging.message.receiver.applications.ApplicationsEventMessageDelegator}
- Failed to retrieve application status event message
java.lang.RuntimeException: Failed to process message using available message
processors: [type]
org.apache.stratos.messaging.event.applications.ApplicationTerminatingEvent
[body] {"appId":"mysql-only-app"}
at
org.apache.stratos.messaging.message.processor.applications.ApplicationUndeployedMessageProcessor.process(ApplicationUndeployedMessageProcessor.java:93)
at
org.apache.stratos.messaging.message.processor.applications.ApplicationTerminatedMessageProcessor.process(ApplicationTerminatedMessageProcessor.java:85)
at
org.apache.stratos.messaging.message.processor.applications.CompleteApplicationsMessageProcessor.process(CompleteApplicationsMessageProcessor.java:69)
at
org.apache.stratos.messaging.message.processor.applications.ApplicationTerminatingMessageProcessor.process(ApplicationTerminatingMessageProcessor.java:72)
at
org.apache.stratos.messaging.message.processor.applications.ApplicationInactivatedMessageProcessor.process(ApplicationInactivatedMessageProcessor.java:72)
at
org.apache.stratos.messaging.message.processor.applications.ApplicationCreatedMessageProcessor.process(ApplicationCreatedMessageProcessor.java:67)
at
org.apache.stratos.messaging.message.processor.applications.ApplicationActivatedMessageProcessor.process(ApplicationActivatedMessageProcessor.java:72)
at
org.apache.stratos.messaging.message.processor.applications.GroupTerminatingProcessor.process(GroupTerminatingProcessor.java:69)
at
org.apache.stratos.messaging.message.processor.applications.GroupTerminatedProcessor.process(GroupTerminatedProcessor.java:69)
at
org.apache.stratos.messaging.message.processor.applications.GroupInActivateProcessor.process(GroupInActivateProcessor.java:69)
at
org.apache.stratos.messaging.message.processor.applications.GroupActivatedProcessor.process(GroupActivatedProcessor.java:69)
at
org.apache.stratos.messaging.message.processor.applications.GroupResetProcessor.process(GroupResetProcessor.java:69)
at
org.apache.stratos.messaging.message.processor.MessageProcessorChain.process(MessageProcessorChain.java:60)
at
org.apache.stratos.messaging.message.receiver.applications.ApplicationsEventMessageDelegator.run(ApplicationsEventMessageDelegator.java:71)
at java.lang.Thread.run(Thread.java:662)
[2014-11-07 12:21:41,952] INFO
{org.apache.stratos.cloud.controller.topology.TopologyEventPublisher} -
Publishing Cluster terminating event: [appId] null [cluster id]
mymysql.mysql.domain
[2014-11-07 12:21:41,968] INFO
{org.apache.stratos.autoscaler.event.receiver.topology.AutoscalerTopologyEventReceiver}
- [ClusterTerminatingEvent] Received: class
org.apache.stratos.messaging.event.topology.ClusterTerminatingEvent
[2014-11-07 12:21:41,968] INFO
{org.apache.stratos.autoscaler.monitor.cluster.AbstractClusterMonitor} -
[Cluster] mymysql.mysql.domain is not notifying the parent, since it is in
Terminating State
[2014-11-07 12:21:41,969] INFO
{org.apache.stratos.autoscaler.monitor.cluster.VMClusterMonitor} - Starting to
terminate all members in Network Partition [ ec2 ], Partition [ p1 ]
[2014-11-07 12:21:41,969] INFO
{org.apache.stratos.autoscaler.monitor.cluster.VMClusterMonitor} - Terminating
pending member [member id]
mymysql.mysql.domainc81c80b9-2449-4064-8d6e-cf5a746e26ed
[2014-11-07 12:21:41,970] INFO
{org.apache.stratos.autoscaler.client.CloudControllerClient} - Terminating
instance via cloud controller: [member]
mymysql.mysql.domainc81c80b9-2449-4064-8d6e-cf5a746e26ed
[2014-11-07 12:21:41,984] INFO
{org.apache.stratos.cloud.controller.impl.CloudControllerServiceImpl} -
Starting to terminate an instance with member id :
mymysql.mysql.domainc81c80b9-2449-4064-8d6e-cf5a746e26ed in partition id: p1 of
cluster id: mymysql.mysql.domain and of cartridge type: mysql
> Error while undeploying application
> -----------------------------------
>
> Key: STRATOS-941
> URL: https://issues.apache.org/jira/browse/STRATOS-941
> Project: Stratos
> Issue Type: Bug
> Reporter: Udara Liyanage
>
> [2014-11-07 12:16:17,328] INFO
> {org.apache.stratos.autoscaler.applications.topic.ApplicationBuilder} -
> Un-deploying the [application] mysql-onlyby marking it as terminating..
> [2014-11-07 12:16:17,329] INFO
> {org.apache.stratos.autoscaler.applications.topic.ApplicationBuilder} -
> Applicationmysql-only updated as terminating
> [2014-11-07 12:16:17,329] INFO
> {org.apache.stratos.autoscaler.monitor.application.ApplicationMonitor} -
> [ApplicationMonitor] mysql-only state changes from Created to Terminating
> [2014-11-07 12:16:17,331] INFO
> {org.apache.stratos.autoscaler.event.publisher.ClusterStatusEventPublisher} -
> Publishing Cluster Terminating event for [application]: null [cluster]:
> mymysql.mysql.domain
> [2014-11-07 12:16:17,347] INFO
> {org.apache.stratos.messaging.domain.topology.lifecycle.LifeCycleStateManager}
> - Topology element [ mymysql.mysql.domain ]'s life Cycle State changed from
> [ Created ] to [ Terminating ]
> [2014-11-07 12:16:17,364] INFO
> {org.apache.stratos.autoscaler.applications.topic.ApplicationsEventPublisher}
> - Publishing Application terminated event for [application]: mysql-only
> [2014-11-07 12:16:17,378] ERROR
> {org.apache.stratos.messaging.message.receiver.applications.ApplicationsEventMessageDelegator}
> - Failed to retrieve application status event message
> java.lang.RuntimeException: Failed to process message using available message
> processors: [type]
> org.apache.stratos.messaging.event.applications.ApplicationTerminatingEvent
> [body] {"appId":"mysql-only"}
> at
> org.apache.stratos.messaging.message.processor.applications.ApplicationUndeployedMessageProcessor.process(ApplicationUndeployedMessageProcessor.java:93)
> at
> org.apache.stratos.messaging.message.processor.applications.ApplicationTerminatedMessageProcessor.process(ApplicationTerminatedMessageProcessor.java:85)
> at
> org.apache.stratos.messaging.message.processor.applications.CompleteApplicationsMessageProcessor.process(CompleteApplicationsMessageProcessor.java:69)
> at
> org.apache.stratos.messaging.message.processor.applications.ApplicationTerminatingMessageProcessor.process(ApplicationTerminatingMessageProcessor.java:72)
> at
> org.apache.stratos.messaging.message.processor.applications.ApplicationInactivatedMessageProcessor.process(ApplicationInactivatedMessageProcessor.java:72)
> at
> org.apache.stratos.messaging.message.processor.applications.ApplicationCreatedMessageProcessor.process(ApplicationCreatedMessageProcessor.java:67)
> at
> org.apache.stratos.messaging.message.processor.applications.ApplicationActivatedMessageProcessor.process(ApplicationActivatedMessageProcessor.java:72)
> at
> org.apache.stratos.messaging.message.processor.applications.GroupTerminatingProcessor.process(GroupTerminatingProcessor.java:69)
> at
> org.apache.stratos.messaging.message.processor.applications.GroupTerminatedProcessor.process(GroupTerminatedProcessor.java:69)
> at
> org.apache.stratos.messaging.message.processor.applications.GroupInActivateProcessor.process(GroupInActivateProcessor.java:69)
> at
> org.apache.stratos.messaging.message.processor.applications.GroupActivatedProcessor.process(GroupActivatedProcessor.java:69)
> at
> org.apache.stratos.messaging.message.processor.applications.GroupResetProcessor.process(GroupResetProcessor.java:69)
> at
> org.apache.stratos.messaging.message.processor.MessageProcessorChain.process(MessageProcessorChain.java:60)
> at
> org.apache.stratos.messaging.message.receiver.applications.ApplicationsEventMessageDelegator.run(ApplicationsEventMessageDelegator.java:71)
> at java.lang.Thread.run(Thread.java:662)
> [2014-11-07 12:16:17,445] INFO
> {org.apache.stratos.cloud.controller.topology.TopologyEventPublisher} -
> Publishing Cluster terminating event: [appId] null [cluster id]
> mymysql.mysql.domain
> [2014-11-07 12:16:17,458] INFO
> {org.apache.stratos.messaging.domain.topology.lifecycle.LifeCycleStateManager}
> - Topology element [ mymysql.mysql.domain ]'s life Cycle State changed from
> [ Created ] to [ Terminating ]
> [2014-11-07 12:16:17,460] INFO
> {org.apache.stratos.autoscaler.event.receiver.topology.AutoscalerTopologyEventReceiver}
> - [ClusterTerminatingEvent] Received: class
> org.apache.stratos.messaging.event.topology.ClusterTerminatingEvent
> [2014-11-07 12:16:17,461] INFO
> {org.apache.stratos.autoscaler.monitor.cluster.AbstractClusterMonitor} -
> [Cluster] mymysql.mysql.domain is not notifying the parent, since it is in
> Terminating State
> [2014-11-07 12:16:17,469] INFO
> {org.apache.stratos.autoscaler.monitor.cluster.VMClusterMonitor} - Starting
> to terminate all members in Network Partition [ ec2 ], Partition [ p1 ]
> [2014-11-07 12:16:17,469] INFO
> {org.apache.stratos.autoscaler.monitor.cluster.VMClusterMonitor} -
> Terminating pending member [member id]
> mymysql.mysql.domain980d95d4-1117-45ec-93b8-b54961c6f145
> [2014-11-07 12:16:17,469] INFO
> {org.apache.stratos.autoscaler.client.CloudControllerClient} - Terminating
> instance via cloud controller: [member]
> mymysql.mysql.domain980d95d4-1117-45ec-93b8-b54961c6f145
> [2014-11-07 12:16:17,481] ERROR
> {org.apache.stratos.cloud.controller.impl.CloudControllerServiceImpl} -
> Termination failed. Invalid Member Id:
> mymysql.mysql.domain980d95d4-1117-45ec-93b8-b54961c6f145
> [2014-11-07 12:16:17,482] ERROR
> {org.apache.axis2.rpc.receivers.RPCInOnlyMessageReceiver} - Termination
> failed. Invalid Member Id:
> mymysql.mysql.domain980d95d4-1117-45ec-93b8-b54961c6f145
> org.apache.stratos.cloud.controller.exception.InvalidMemberException:
> Termination failed. Invalid Member Id:
> mymysql.mysql.domain980d95d4-1117-45ec-93b8-b54961c6f145
> at
> org.apache.stratos.cloud.controller.impl.CloudControllerServiceImpl.terminateInstance(CloudControllerServiceImpl.java:619)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at
> org.apache.axis2.rpc.receivers.RPCUtil.invokeServiceClass(RPCUtil.java:212)
> at
> org.apache.axis2.rpc.receivers.RPCInOnlyMessageReceiver.invokeBusinessLogic(RPCInOnlyMessageReceiver.java:66)
> at
> org.apache.axis2.receivers.AbstractMessageReceiver.receive(AbstractMessageReceiver.java:110)
> at org.apache.axis2.engine.AxisEngine.receive(AxisEngine.java:180)
> at
> org.apache.axis2.transport.http.HTTPTransportUtils.processHTTPPostRequest(HTTPTransportUtils.java:172)
> at
> org.apache.axis2.transport.http.AxisServlet.doPost(AxisServlet.java:146)
> at
> org.wso2.carbon.core.transports.CarbonServlet.doPost(CarbonServlet.java:231)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:755)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:848)
> at
> org.eclipse.equinox.http.servlet.internal.ServletRegistration.service(ServletRegistration.java:61)
> at
> org.eclipse.equinox.http.servlet.internal.ProxyServlet.processAlias(ProxyServlet.java:128)
> at
> org.eclipse.equinox.http.servlet.internal.ProxyServlet.service(ProxyServlet.java:68)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:848)
> at
> org.wso2.carbon.tomcat.ext.servlet.DelegationServlet.service(DelegationServlet.java:68)
> at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:305)
> at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
> at
> org.wso2.carbon.tomcat.ext.filter.CharacterSetFilter.doFilter(CharacterSetFilter.java:61)
> at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
> at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
> at
> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:222)
> at
> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:123)
> at
> org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:472)
> at
> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:171)
> at
> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:99)
> at
> org.wso2.carbon.tomcat.ext.valves.CompositeValve.continueInvocation(CompositeValve.java:178)
> at
> org.wso2.carbon.tomcat.ext.valves.CarbonTomcatValve$1.invoke(CarbonTomcatValve.java:47)
> at
> org.wso2.carbon.webapp.mgt.TenantLazyLoaderValve.invoke(TenantLazyLoaderValve.java:56)
> at
> org.wso2.carbon.tomcat.ext.valves.TomcatValveContainer.invokeValves(TomcatValveContainer.java:47)
> at
> org.wso2.carbon.tomcat.ext.valves.CompositeValve.invoke(CompositeValve.java:141)
> at
> org.wso2.carbon.tomcat.ext.valves.CarbonStuckThreadDetectionValve.invoke(CarbonStuckThreadDetectionValve.java:156)
> at
> org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:936)
> at
> org.wso2.carbon.tomcat.ext.valves.CarbonContextCreatorValve.invoke(CarbonContextCreatorValve.java:52)
> at
> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118)
> at
> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:407)
> at
> org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1004)
> at
> org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:589)
> at
> org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:1653)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
> at java.lang.Thread.run(Thread.java:662)
> [2014-11-07 12:16:17,515] ERROR
> {org.apache.stratos.autoscaler.client.CloudControllerClient} - Termination
> failed. Invalid Member Id:
> mymysql.mysql.domain980d95d4-1117-45ec-93b8-b54961c6f145
> org.apache.axis2.AxisFault: Termination failed. Invalid Member Id:
> mymysql.mysql.domain980d95d4-1117-45ec-93b8-b54961c6f145
> at
> org.apache.axis2.util.Utils.getInboundFaultFromMessageContext(Utils.java:531)
> at
> org.apache.axis2.description.RobustOutOnlyAxisOperation$RobustOutOnlyOperationClient.handleResponse(RobustOutOnlyAxisOperation.java:91)
> at
> org.apache.axis2.description.OutInAxisOperationClient.send(OutInAxisOperation.java:445)
> at
> org.apache.axis2.description.OutInAxisOperationClient.executeImpl(OutInAxisOperation.java:225)
> at
> org.apache.axis2.client.OperationClient.execute(OperationClient.java:149)
> at
> org.apache.stratos.cloud.controller.stub.CloudControllerServiceStub.terminateInstance(CloudControllerServiceStub.java:1832)
> at
> org.apache.stratos.autoscaler.client.CloudControllerClient.terminate(CloudControllerClient.java:250)
> at
> org.apache.stratos.autoscaler.monitor.cluster.VMClusterMonitor.terminateMember(VMClusterMonitor.java:714)
> at
> org.apache.stratos.autoscaler.monitor.cluster.VMClusterMonitor.access$100(VMClusterMonitor.java:55)
> at
> org.apache.stratos.autoscaler.monitor.cluster.VMClusterMonitor$1.run(VMClusterMonitor.java:693)
> at java.lang.Thread.run(Thread.java:662)
> [2014-11-07 12:16:17,516] ERROR
> {org.apache.stratos.autoscaler.monitor.cluster.VMClusterMonitor} - Unable to
> terminate member [member id ]
> mymysql.mysql.domain980d95d4-1117-45ec-93b8-b54961c6f145
> org.apache.stratos.autoscaler.exception.TerminationException: Termination
> failed. Invalid Member Id:
> mymysql.mysql.domain980d95d4-1117-45ec-93b8-b54961c6f145
> at
> org.apache.stratos.autoscaler.client.CloudControllerClient.terminate(CloudControllerClient.java:258)
> at
> org.apache.stratos.autoscaler.monitor.cluster.VMClusterMonitor.terminateMember(VMClusterMonitor.java:714)
> at
> org.apache.stratos.autoscaler.monitor.cluster.VMClusterMonitor.access$100(VMClusterMonitor.java:55)
> at
> org.apache.stratos.autoscaler.monitor.cluster.VMClusterMonitor$1.run(VMClusterMonitor.java:693)
> at java.lang.Thread.run(Thread.java:662)
> Caused by: org.apache.axis2.AxisFault: Termination failed. Invalid Member Id:
> mymysql.mysql.domain980d95d4-1117-45ec-93b8-b54961c6f145
> at
> org.apache.axis2.util.Utils.getInboundFaultFromMessageContext(Utils.java:531)
> at
> org.apache.axis2.description.RobustOutOnlyAxisOperation$RobustOutOnlyOperationClient.handleResponse(RobustOutOnlyAxisOperation.java:91)
> at
> org.apache.axis2.description.OutInAxisOperationClient.send(OutInAxisOperation.java:445)
> at
> org.apache.axis2.description.OutInAxisOperationClient.executeImpl(OutInAxisOperation.java:225)
> at
> org.apache.axis2.client.OperationClient.execute(OperationClient.java:149)
> at
> org.apache.stratos.cloud.controller.stub.CloudControllerServiceStub.terminateInstance(CloudControllerServiceStub.java:1832)
> at
> org.apache.stratos.autoscaler.client.CloudControllerClient.terminate(CloudControllerClient.java:250)
> ... 4 more
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
