Hi,
I am still getting this error
[2015-02-25 11:36:49,208] INFO
{org.apache.stratos.autoscaler.status.processor.group.GroupStatusTerminatedProcessor}
- sending application terminated for [application] single-cartridge-app
[instance] single-cartridge-app-1
[2015-02-25 11:36:49,209] ERROR
{org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas} -
Could not terminate container, member context not found: [member-id]
php1.php.domaind67c6e31-fd41-4e27-847b-e5f07d4ccba7
[2015-02-25 11:36:49,210] INFO
{org.apache.stratos.autoscaler.applications.topic.ApplicationsEventPublisher}
- Publishing application terminated event: [application]
single-cartridge-app [instance] single-cartridge-app-1
[2015-02-25 11:36:49,211] ERROR
{org.apache.stratos.cloud.controller.services.impl.InstanceTerminator} -
Instance termination failed! MemberContext
[applicationId=single-cartridge-app, cartridgeType=php,
clusterId=php1.php.domain,
memberId=php1.php.domaind67c6e31-fd41-4e27-847b-e5f07d4ccba7,
instanceId=null, partition=Partition [id=partition-1, description=null,
isPublic=false, provider=kubernetes, partitionMin=0, partitionMax=0,
properties=Properties [properties=[Property [name=region,
value=default]]]], defaultPrivateIP=null, defaultPublicIP=null,
allocatedIPs=null, publicIPs=null, privateIPs=null, initTime=1424843826027,
lbClusterId=null, networkPartitionId=network-partition-1,
kubernetesPodId=php1-php-domaind67c6e31-fd41-4e27-847b-e5f07d4ccba7,
kubernetesPodName=php1-php-domaind67c6e31-fd41-4e27-847b-e5f07d4ccba7,
instanceMetadata=null, properties=Properties [properties=[Property
[name=PRIMARY, value=false], Property [name=MIN_COUNT, value=1]]]]
java.lang.IllegalArgumentException: Could not terminate container, member
context not found: [member-id]
php1.php.domaind67c6e31-fd41-4e27-847b-e5f07d4ccba7
at
org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas.handleNullObject(KubernetesIaas.java:689)
at
org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas.terminateContainer(KubernetesIaas.java:610)
at
org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas.terminateInstance(KubernetesIaas.java:129)
at
org.apache.stratos.cloud.controller.services.impl.InstanceTerminator.run(InstanceTerminator.java:56)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
Exception in thread "pool-27-thread-2"
org.apache.stratos.cloud.controller.exception.CloudControllerException:
Instance termination failed! MemberContext
[applicationId=single-cartridge-app, cartridgeType=php,
clusterId=php1.php.domain,
memberId=php1.php.domaind67c6e31-fd41-4e27-847b-e5f07d4ccba7,
instanceId=null, partition=Partition [id=partition-1, description=null,
isPublic=false, provider=kubernetes, partitionMin=0, partitionMax=0,
properties=Properties [properties=[Property [name=region,
value=default]]]], defaultPrivateIP=null, defaultPublicIP=null,
allocatedIPs=null, publicIPs=null, privateIPs=null, initTime=1424843826027,
lbClusterId=null, networkPartitionId=network-partition-1,
kubernetesPodId=php1-php-domaind67c6e31-fd41-4e27-847b-e5f07d4ccba7,
kubernetesPodName=php1-php-domaind67c6e31-fd41-4e27-847b-e5f07d4ccba7,
instanceMetadata=null, properties=Properties [properties=[Property
[name=PRIMARY, value=false], Property [name=MIN_COUNT, value=1]]]]
at
org.apache.stratos.cloud.controller.services.impl.InstanceTerminator.run(InstanceTerminator.java:63)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
Caused by: java.lang.IllegalArgumentException: Could not terminate
container, member context not found: [member-id]
php1.php.domaind67c6e31-fd41-4e27-847b-e5f07d4ccba7
at
org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas.handleNullObject(KubernetesIaas.java:689)
at
org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas.terminateContainer(KubernetesIaas.java:610)
at
org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas.terminateInstance(KubernetesIaas.java:129)
at
org.apache.stratos.cloud.controller.services.impl.InstanceTerminator.run(InstanceTerminator.java:56)
... 3 more
[2015-02-25 11:36:49,232] WARN
{org.apache.stratos.messaging.message.processor.application.ApplicationInstanceTerminatedMessageProcessor}
- Application with id [ single-cartridge-app ] still exists in
Applications, removing it
[2015-02-25 11:36:49,233] WARN
{org.apache.stratos.messaging.message.processor.application.ApplicationInstanceTerminatedMessageProcessor}
- Application with id [ single-cartridge-app ] still exists in
Applications, removing it
[2015-02-25 11:36:49,237] INFO
{org.apache.stratos.autoscaler.applications.topic.ApplicationBuilder} -
Application run time is removed: [application-id] single-cartridge-app
On Mon, Feb 23, 2015 at 10:32 PM, Imesh Gunaratne <[email protected]> wrote:
> I have now fixed member context persistence logic with the following
> commit revision:
> f31dc2805026458006567212b968ba7d6c54ca29
>
> Thanks
>
> On Mon, Feb 23, 2015 at 10:02 PM, Imesh Gunaratne <[email protected]>
> wrote:
>
>> Yes exactly Raj, I'm now fixing this.
>>
>> On Mon, Feb 23, 2015 at 9:58 PM, Rajkumar Rajaratnam <[email protected]>
>> wrote:
>>
>>> Hi Imesh,
>>>
>>> Reason is we are adding the member context to cloud controller context
>>> after everything goes fine. We need to add the member context to the cloud
>>> controller context as soon as cloud controller gets an instance start up
>>> call. Otherwise AS and CC would not be in the same state (AS already added
>>> the member to pending list). I guess we discussed this in some other
>>> threads.
>>>
>>> Now in this scenario, something went wrong while creating containers. So
>>> CC didn't add it to the cc context. This leads to the above error.
>>>
>>> Thanks.
>>>
>>> On Mon, Feb 23, 2015 at 9:47 PM, Imesh Gunaratne <[email protected]>
>>> wrote:
>>>
>>>> Hi Devs,
>>>>
>>>> I see the below error when terminating a container after an
>>>> unsuccessful container start process. I'm now looking into this.
>>>>
>>>> [2015-02-23 21:12:05,837] ERROR
>>>> {org.apache.stratos.cloud.controller.services.impl.CloudControllerServiceImpl}
>>>> - Could not terminate instance: [member-id]
>>>> tomcat-1.tomcat.domain4dd97cbc-0a4d-40f9-b01a-894b3b27d6e8
>>>> org.apache.stratos.cloud.controller.exception.InvalidMemberException:
>>>> Could not terminate instance, member context not found: [member-id]
>>>> tomcat-1.tomcat.domain4dd97cbc-0a4d-40f9-b01a-894b3b27d6e8
>>>> at
>>>> org.apache.stratos.cloud.controller.services.impl.CloudControllerServiceImpl.terminateInstance(CloudControllerServiceImpl.java:554)
>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>> at
>>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>>>> at
>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>>> at java.lang.reflect.Method.invoke(Method.java:606)
>>>> at
>>>> org.apache.axis2.rpc.receivers.RPCUtil.invokeServiceClass(RPCUtil.java:212)
>>>> at
>>>> org.apache.axis2.rpc.receivers.RPCInOnlyMessageReceiver.invokeBusinessLogic(RPCInOnlyMessageReceiver.java:66)
>>>> at
>>>> org.apache.axis2.receivers.AbstractMessageReceiver.receive(AbstractMessageReceiver.java:110)
>>>> at org.apache.axis2.engine.AxisEngine.receive(AxisEngine.java:180)
>>>> at
>>>> org.apache.axis2.transport.http.HTTPTransportUtils.processHTTPPostRequest(HTTPTransportUtils.java:172)
>>>> at
>>>> org.apache.axis2.transport.http.AxisServlet.doPost(AxisServlet.java:146)
>>>> at
>>>> org.wso2.carbon.core.transports.CarbonServlet.doPost(CarbonServlet.java:231)
>>>>
>>>>
>>>> --
>>>> Imesh Gunaratne
>>>>
>>>> Technical Lead, WSO2
>>>> Committer & PMC Member, Apache Stratos
>>>>
>>>
>>>
>>>
>>> --
>>> Rajkumar Rajaratnam
>>> Committer & PMC Member, Apache Stratos
>>> Software Engineer, WSO2
>>>
>>> Mobile : +94777568639
>>> Blog : rajkumarr.com
>>>
>>
>>
>>
>> --
>> Imesh Gunaratne
>>
>> Technical Lead, WSO2
>> Committer & PMC Member, Apache Stratos
>>
>
>
>
> --
> Imesh Gunaratne
>
> Technical Lead, WSO2
> Committer & PMC Member, Apache Stratos
>
--
Udara Liyanage
Software Engineer
WSO2, Inc.: http://wso2.com
lean. enterprise. middleware
web: http://udaraliyanage.wordpress.com
phone: +94 71 443 6897
