Nirmal Fernando created STRATOS-887:
---------------------------------------
Summary: Intermittent failure on receiving ClusterRemovedEvent at
Autoscaler
Key: STRATOS-887
URL: https://issues.apache.org/jira/browse/STRATOS-887
Project: Stratos
Issue Type: Bug
Components: Messaging
Affects Versions: 4.1.0 M2
Reporter: Nirmal Fernando
Assignee: Gayan Gunarathne
Fix For: 4.1.0 M3
Subscribe and unsubscribe from the cluster - intermittently you could reproduce
this.
TID: [0] [STRATOS] [2014-10-12 16:15:22,150] INFO
{org.apache.stratos.manager.listener.InstanceStatusListener} - Event class
name:
org.apache.stratos.messaging.event.instance.status.InstanceReadyToShutdownEvent
TID: [0] [STRATOS] [2014-10-12 16:15:22,152] WARN
{org.apache.stratos.cloud.controller.topology.TopologyBuilder} - Member
c719d11e-51fc-11e4-90e0-080027dcc108 does not exist
TID: [0] [STRATOS] [2014-10-12 16:15:22,295] WARN
{org.apache.stratos.cloud.controller.topology.TopologyBuilder} - Member with
member id 781f66d0-51fc-11e4-90e0-080027dcc108 does not exist
TID: [0] [STRATOS] [2014-10-12 16:15:22,295] INFO
{org.apache.stratos.cloud.controller.runtime.FasterLookUpDataHolder} -
Scheduled Pod Activation Watcher task canceled.
TID: [0] [STRATOS] [2014-10-12 16:15:22,317] INFO
{org.apache.stratos.cloud.controller.topology.TopologyEventPublisher} -
Publishing cluster removed event: [service] php [cluster] myphp.php.domain
TID: [0] [STRATOS] [2014-10-12 16:15:22,324] INFO
{org.apache.stratos.messaging.message.receiver.topology.TopologyEventMessageListener}
- ******* message received : 458100494 ***** topic:
topology/ClusterRemovedEvent
TID: [0] [STRATOS] [2014-10-12 16:15:22,324] INFO
{org.apache.stratos.messaging.message.receiver.topology.TopologyEventMessageListener}
- $$$$$$$$$$$ MqttMessage received 458100494 $$$$$$$$$topic:
topology/ClusterRemovedEvent
TID: [0] [STRATOS] [2014-10-12 16:15:22,325] INFO
{org.apache.stratos.messaging.message.receiver.topology.TopologyEventMessageListener}
- ******* message received : 566128163 ***** topic:
topology/ClusterRemovedEvent
TID: [0] [STRATOS] [2014-10-12 16:15:22,325] INFO
{org.apache.stratos.messaging.message.receiver.topology.TopologyEventMessageListener}
- $$$$$$$$$$$ MqttMessage received 566128163 $$$$$$$$$topic:
topology/ClusterRemovedEvent
TID: [0] [STRATOS] [2014-10-12 16:15:22,325] INFO
{org.apache.stratos.messaging.message.receiver.topology.TopologyEventMessageListener}
- ******* message received : 1563479331 ***** topic:
topology/ClusterRemovedEvent
TID: [0] [STRATOS] [2014-10-12 16:15:22,325] INFO
{org.apache.stratos.messaging.message.receiver.topology.TopologyEventMessageListener}
- $$$$$$$$$$$ MqttMessage received 1563479331 $$$$$$$$$topic:
topology/ClusterRemovedEvent
TID: [0] [STRATOS] [2014-10-12 16:15:22,338] INFO
{org.apache.stratos.manager.behaviour.CartridgeMgtBehaviour} - Unregistered
service cluster, domain myphp.php.domain
TID: [0] [STRATOS] [2014-10-12 16:15:22,354] INFO
{org.apache.stratos.manager.subscription.utils.CartridgeSubscriptionUtils} -
Publishing tenant un-subscribed event: [tenant-id] -1234 [service] php
TID: [0] [STRATOS] [2014-10-12 16:15:26,939] DEBUG
{org.apache.stratos.autoscaler.monitor.KubernetesServiceClusterMonitor} -
KubernetesServiceClusterMonitor is running.. KubernetesServiceClusterMonitor [
kubernetesHostClusterId=KubGrp1, clusterId=myphp.php.domain, serviceId=php]
TID: [0] [STRATOS] [2014-10-12 16:15:26,940] DEBUG
{org.apache.stratos.autoscaler.monitor.KubernetesServiceClusterMonitor} -
Running min check for [kub-cluster] : KubGrp1 [cluster] : myphp.php.domain
TID: [0] [STRATOS] [2014-10-12 16:15:26,940] INFO
{org.apache.stratos.autoscaler.rule.RuleLog} - Running minimum rule:
[kub-cluster] KubGrp1 [cluster] myphp.php.domain
TID: [0] [STRATOS] [2014-10-12 16:15:26,941] INFO
{org.apache.stratos.autoscaler.rule.RuleLog} - [min-check] [cluster] :
myphp.php.domain [Replicas] nonTerminated : 1
TID: [0] [STRATOS] [2014-10-12 16:15:26,941] INFO
{org.apache.stratos.autoscaler.rule.RuleLog} - [min-check] [cluster] :
myphp.php.domain [Replicas] minReplicas : 2
TID: [0] [STRATOS] [2014-10-12 16:15:26,941] INFO
{org.apache.stratos.autoscaler.rule.RuleLog} - Running obsolete containers
rule [kub-cluster] : KubGrp1 [cluster] : myphp.php.domain
TID: [0] [STRATOS] [2014-10-12 16:15:26,942] INFO
{org.apache.stratos.autoscaler.rule.RuleLog} - [obsolete-check] [cluster] :
myphp.php.domain [Replicas] obsoleteReplicas : 0
TID: [0] [STRATOS] [2014-10-12 16:15:26,943] INFO
{org.apache.stratos.autoscaler.rule.RuleLog} - [min-check] Decided to scale-up
: [cluster] : myphp.php.domain
TID: [0] [STRATOS] [2014-10-12 16:15:26,943] INFO
{org.apache.stratos.autoscaler.rule.RuleLog} - [min-check] [cluster] :
myphp.php.domain ; min-rule not satisfied, scaling up to minReplicas : 2
TID: [0] [STRATOS] [2014-10-12 16:15:26,944] INFO
{org.apache.stratos.autoscaler.client.cloud.controller.CloudControllerClient} -
Updating kubernetes replication controller via cloud controller: [cluster]
myphp.php.domain [replicas] 2
TID: [0] [STRATOS] [2014-10-12 16:15:26,953] ERROR
{org.apache.stratos.cloud.controller.impl.CloudControllerServiceImpl} -
Instance start-up failed. Invalid cluster id. myphp.php.domain
TID: [0] [STRATOS] [2014-10-12 16:15:26,953] ERROR
{org.apache.axis2.rpc.receivers.RPCMessageReceiver} - Instance start-up
failed. Invalid cluster id. myphp.php.domain
java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
