I also tried looking in the SMlog on the host machine and did not see
anything out of the ordinary there.
In the xensource log I found the following where it references a VDI =
invalid after which it destroys the VM.
[20140929T23:26:25.360Z|debug|srvengxen02|28792520 inet-RPC|VBD.create
R:92cef04c77be|audit] VBD.create: VM =
'71314961-a1bf-689e-eaec-73b9e3639db8 (i-3-98-VM)'; VDI =
'18801349-c195-468a-99db-67534434d137'
[20140929T23:26:25.360Z|debug|srvengxen02|28792608
unix-RPC||dummytaskhelper] task dispatch:SR.get_by_uuid D:41de8bc7f75c
created by task R:e85d97df8f66
[20140929T23:26:25.366Z|debug|srvengxen02|28792520 inet-RPC|VBD.create
R:92cef04c77be|xapi] VBD.create (device = 0; uuid =
9297b527-7b1f-600c-0d55-8486a8bd35d7; ref =
OpaqueRef:f2c07f6f-6f4c-0f50-e38c-b4e7a5e280e6)
[20140929T23:26:25.377Z|debug|srvengxen02|28792609
unix-RPC||dummytaskhelper] task dispatch:VDI.get_all_records_where
D:05a8c79e50bf created by task R:e85d97df8f66
[20140929T23:26:25.415Z| info|srvengxen02|28792610
unix-RPC|session.login_with_password D:ced9199f4e0c|xapi] Session.create
trackid=9624f0c2f5e5bd3038fb6a99acc9fabb pool=false uname=root
is_local_superuser=true auth_user_sid=
parent=trackid=9834f5af41c964e225f24279aefe4e49
[20140929T23:26:25.423Z|debug|srvengxen02|28792610
unix-RPC|session.login_with_password D:ced9199f4e0c|xapi] Attempting to
open /var/xapi/xapi
[20140929T23:26:25.424Z| info|srvengxen02|28792518 inet-RPC|sm_exec
D:f9b7a7e773dc|xapi] Session.destroy
trackid=359335e97d06233dc28a816141253bbd
[20140929T23:26:25.429Z|debug|srvengxen02|28792518 inet-RPC|SR.scan
R:e85d97df8f66|xapi] Unmarking SR after SR.scan
(task=OpaqueRef:e85d97df-8f66-9c31-cbd9-c8957ad49af3)
[20140929T23:26:25.433Z|debug|srvengxen02|28792611
unix-RPC||dummytaskhelper] task dispatch:host.get_other_config
D:0e4ea6af7e73 created by task R:50e59a397731
[20140929T23:26:25.435Z|debug|srvengxen02|28792612
unix-RPC||dummytaskhelper] task dispatch:session.get_uuid D:195d11136faa
created by task D:ced9199f4e0c
[20140929T23:26:25.493Z|debug|srvengxen02|28792614
unix-RPC||dummytaskhelper] task dispatch:SR.get_by_uuid D:9dc0edeee20c
created by task R:50e59a397731
[20140929T23:26:25.508Z|debug|srvengxen02|28792616
unix-RPC||dummytaskhelper] task dispatch:VDI.get_all_records_where
D:903ce3656dc9 created by task R:50e59a397731
[20140929T23:26:25.528Z|debug|srvengxen02|28792520 inet-RPC|VBD.create
R:f1336eb3be75|audit] VBD.create: VM =
'71314961-a1bf-689e-eaec-73b9e3639db8 (i-3-98-VM)'; VDI =
'a343a4a0-1a7c-45b6-8e64-1e1ed1bdfd48'
[20140929T23:26:25.551Z|debug|srvengxen02|28792520 inet-RPC|VBD.create
R:f1336eb3be75|xapi] VBD.create (device = 1; uuid =
6609b989-ec81-10c1-8b00-b1fb1eb3885f; ref =
OpaqueRef:50aad4c1-6cfa-cd28-5788-ef75a7124b8a)
[20140929T23:26:25.584Z|debug|srvengxen02|28792518
inet-RPC|host.call_plugin R:c855f78ec429|audit] Host.call_plugin host =
'63befa52-4c03-460a-9557-9100d51cedaf (srvengxen02)'; plugin = 'echo'; fn =
'main'; args = [ ]
[20140929T23:26:25.602Z|debug|srvengxen02|28792621
unix-RPC||dummytaskhelper] task dispatch:SR.get_by_uuid D:6ba0551a82ed
created by task R:50e59a397731
[20140929T23:26:25.638Z|debug|srvengxen02|28792623
unix-RPC||dummytaskhelper] task dispatch:SR.set_virtual_allocation
D:8058d66fa46e created by task R:50e59a397731
[20140929T23:26:25.648Z|debug|srvengxen02|28792520 inet-RPC|VBD.create
R:ef5d48345ac5|audit] VBD.create: VM =
'71314961-a1bf-689e-eaec-73b9e3639db8 (i-3-98-VM)'; VDI = 'invalid'
[20140929T23:26:25.655Z|debug|srvengxen02|28792520 inet-RPC|VBD.create
R:ef5d48345ac5|xapi] VBD.create (device = 3; uuid =
d47f3673-7dc8-68ff-7eb7-fcd6ba8b0c41; ref =
OpaqueRef:a73083d7-8947-953d-ee0f-7f6861395417)
[20140929T23:26:25.662Z|debug|srvengxen02|28792625
unix-RPC||dummytaskhelper] task dispatch:SR.set_physical_size
D:98208d41d23a created by task R:50e59a397731
[20140929T23:26:25.713Z|debug|srvengxen02|28792627
unix-RPC||dummytaskhelper] task dispatch:SR.set_physical_utilisation
D:2473b2fa3810 created by task R:50e59a397731
[20140929T23:26:25.766Z|debug|srvengxen02|28792629
unix-RPC||dummytaskhelper] task dispatch:SR.get_by_uuid D:9789f2f4d40b
created by task R:50e59a397731
[20140929T23:26:25.783Z|debug|srvengxen02|28792518 inet-RPC|SR.scan
R:74ead907ad3a|audit] SR.scan: SR = '1058d9b9-4dde-473b-72d6-5e56f1141f96
(17b0a8a5-2376-3d11-b60e-31eebeafb217)'
[20140929T23:26:25.786Z|debug|srvengxen02|28792518 inet-RPC|SR.scan
R:74ead907ad3a|xapi] Marking SR for SR.scan
(task=OpaqueRef:74ead907-ad3a-01c8-9021-b5a1a0e52ee3)
[20140929T23:26:25.790Z|debug|srvengxen02|28792630
unix-RPC||dummytaskhelper] task dispatch:VDI.get_all_records_where
D:557e5dbbb33a created by task R:50e59a397731
[20140929T23:26:25.802Z|debug|srvengxen02|28792518 inet-RPC|SR.scan
R:74ead907ad3a|sm] SM nfs sr_scan
sr=OpaqueRef:a920ca88-cf2f-f50a-faf5-9b17c5740433
[20140929T23:26:25.831Z| info|srvengxen02|28792518 inet-RPC|sm_exec
D:2211094a1f86|xapi] Session.create
trackid=53c2c5386accf7c5f10e4d69510fcede pool=false uname=
is_local_superuser=true auth_user_sid=
parent=trackid=9834f5af41c964e225f24279aefe4e49
[20140929T23:26:25.834Z|debug|srvengxen02|28792518 inet-RPC|sm_exec
D:2211094a1f86|xapi] Attempting to open /var/xapi/xapi
[20140929T23:26:25.838Z|debug|srvengxen02|28792632
unix-RPC||dummytaskhelper] task dispatch:session.get_uuid D:a1be6478ee18
created by task D:2211094a1f86
[20140929T23:26:25.888Z|debug|srvengxen02|28792520 inet-RPC|VM.destroy
R:b8d3f07a5356|audit] VM.destroy: VM =
'71314961-a1bf-689e-eaec-73b9e3639db8 (i-3-98-VM)'
On Mon, Sep 29, 2014 at 4:53 PM, Carlos Reategui <create...@gmail.com>
wrote:
> Following up on my earlier email regarding errors in my logs it appears
> things are not as great as I thought. Trying to launch instances is not
> working. Please help.
> thanks,
> Carlos
>
> ACS: 4.3.1
> Hosts: XenServer 6.2
> Network: Basic Shared Network no SG
>
> Things appear ok up until it tries to create the VIF. Here are the logs:
>
> 2014-09-29 16:26:24,816 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgent-235:ctx-7f8db7ac) Seq 2-868943178: Executing request
>
> 2014-09-29 16:26:25,003 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-235:ctx-7f8db7ac) 1. The VM i-3-98-VM is in Starting state.
>
> 2014-09-29 16:26:25,174 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-235:ctx-7f8db7ac) Created VM
> 71314961-a1bf-689e-eaec-73b9e3639db8 for i-3-98-VM
>
> 2014-09-29 16:26:25,405 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-235:ctx-7f8db7ac) VBD 9297b527-7b1f-600c-0d55-8486a8bd35d7
> created for com.cloud.agent.api.to.DiskTO@53d6031b
>
> 2014-09-29 16:26:25,509 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgent-399:ctx-73a60525) Seq 2-868943177: Response Received:
>
> 2014-09-29 16:26:25,509 DEBUG [c.c.a.t.Request]
> (StatsCollector-3:ctx-13616221) Seq 2-868943177: Received: { Ans: ,
> MgmtId: 233845174730255, via: 2, Ver: v1, Flags: 10, {
> GetStorageStatsAnswer } }
>
> 2014-09-29 16:26:25,512 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgent-392:ctx-401c432d) Seq 2-868943179: Executing request
>
> 2014-09-29 16:26:25,618 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-235:ctx-7f8db7ac) VBD 6609b989-ec81-10c1-8b00-b1fb1eb3885f
> created for com.cloud.agent.api.to.DiskTO@7fbb227a
>
> 2014-09-29 16:26:25,658 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-12:ctx-a4bf4221) ===START=== 172.30.36.159 -- GET
> command=queryAsyncJobResult&jobId=f38a8e56-9a85-48aa-9da2-d498d3179634&response=json&sessionkey=UWhJaGdVTH3zXZ9WFdv4EwAlqA4%3D&_=1412033185658
>
> 2014-09-29 16:26:25,679 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-12:ctx-a4bf4221 ctx-d566be7f) ===END=== 172.30.36.159 --
> GET
> command=queryAsyncJobResult&jobId=f38a8e56-9a85-48aa-9da2-d498d3179634&response=json&sessionkey=UWhJaGdVTH3zXZ9WFdv4EwAlqA4%3D&_=1412033185658
>
> 2014-09-29 16:26:25,735 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-235:ctx-7f8db7ac) VBD d47f3673-7dc8-68ff-7eb7-fcd6ba8b0c41
> created for com.cloud.agent.api.to.DiskTO@194e84ba
>
> 2014-09-29 16:26:25,735 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-235:ctx-7f8db7ac) Creating VIF for i-3-98-VM on nic
> [Nic:Guest-172.30.45.143-null]
>
> 2014-09-29 16:26:25,834 WARN [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-235:ctx-7f8db7ac) Catch Exception: class
> java.lang.NullPointerException due to java.lang.NullPointerException
>
> java.lang.NullPointerException
>
> at
> com.cloud.network.Networks$BroadcastDomainType.getSchemeValue(Networks.java:173)
>
> at
> com.cloud.network.Networks$BroadcastDomainType.getValue(Networks.java:228)
>
> at
> com.cloud.hypervisor.xen.resource.CitrixResourceBase.getNetwork(CitrixResourceBase.java:1035)
>
> at
> com.cloud.hypervisor.xen.resource.CitrixResourceBase.createVif(CitrixResourceBase.java:1088)
>
> at
> com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResourceBase.java:1718)
>
> at
> com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:545)
>
> at
> com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:59)
>
> at
> com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:216)
>
> at
> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
>
> at
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
>
> at
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
>
> at
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
>
> at
> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
>
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
>
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
>
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>
> at java.lang.Thread.run(Thread.java:745)
>
> 2014-09-29 16:26:25,835 WARN [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-235:ctx-7f8db7ac) Unable to start i-3-98-VM due to
>
> java.lang.NullPointerException
>
> at
> com.cloud.network.Networks$BroadcastDomainType.getSchemeValue(Networks.java:173)
>
> at
> com.cloud.network.Networks$BroadcastDomainType.getValue(Networks.java:228)
>
> at
> com.cloud.hypervisor.xen.resource.CitrixResourceBase.getNetwork(CitrixResourceBase.java:1035)
>
> at
> com.cloud.hypervisor.xen.resource.CitrixResourceBase.createVif(CitrixResourceBase.java:1088)
>
> at
> com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResourceBase.java:1718)
>
> at
> com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:545)
>
> at
> com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:59)
>
> at
> com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:216)
>
> at
> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
>
> at
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
>
> at
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
>
> at
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
>
> at
> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
>
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
>
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
>
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>
> at java.lang.Thread.run(Thread.java:745)
>
> 2014-09-29 16:26:26,052 WARN [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-235:ctx-7f8db7ac) Unable to clean up VBD due to
>
> You gave an invalid object reference. The object may have recently been
> deleted. The class parameter gives the type of reference given, and the
> handle parameter echoes the bad value given.
>
> at com.xensource.xenapi.Types.checkResponse(Types.java:209)
>
> at com.xensource.xenapi.Connection.dispatch(Connection.java:368)
>
> at
> com.cloud.hypervisor.xen.resource.XenServerConnectionPool$XenServerConnection.dispatch(XenServerConnectionPool.java:909)
>
> at com.xensource.xenapi.VBD.unplug(VBD.java:1059)
>
> at
> com.cloud.hypervisor.xen.resource.CitrixResourceBase.handleVmStartFailure(CitrixResourceBase.java:1462)
>
> at
> com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResourceBase.java:1800)
>
> at
> com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:545)
>
> at
> com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:59)
>
> at
> com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:216)
>
> at
> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
>
> at
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
>
> at
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
>
> at
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
>
> at
> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
>
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
>
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
>
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>
> at java.lang.Thread.run(Thread.java:745)
>
> 2014-09-29 16:26:26,092 WARN [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-235:ctx-7f8db7ac) Unable to clean up VBD due to
>
> You gave an invalid object reference. The object may have recently been
> deleted. The class parameter gives the type of reference given, and the
> handle parameter echoes the bad value given.
>
> at com.xensource.xenapi.Types.checkResponse(Types.java:209)
>
> at com.xensource.xenapi.Connection.dispatch(Connection.java:368)
>
> at
> com.cloud.hypervisor.xen.resource.XenServerConnectionPool$XenServerConnection.dispatch(XenServerConnectionPool.java:909)
>
> at com.xensource.xenapi.VBD.unplug(VBD.java:1059)
>
> at
> com.cloud.hypervisor.xen.resource.CitrixResourceBase.handleVmStartFailure(CitrixResourceBase.java:1462)
>
> at
> com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResourceBase.java:1800)
>
> at
> com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:545)
>
> at
> com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:59)
>
> at
> com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:216)
>
> at
> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
>
> at
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
>
> at
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
>
> at
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
>
> at
> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
>
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
>
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
>
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>
> at java.lang.Thread.run(Thread.java:745)
>
> 2014-09-29 16:26:26,137 WARN [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-235:ctx-7f8db7ac) Unable to clean up VBD due to
>
> You gave an invalid object reference. The object may have recently been
> deleted. The class parameter gives the type of reference given, and the
> handle parameter echoes the bad value given.
>
> at com.xensource.xenapi.Types.checkResponse(Types.java:209)
>
> at com.xensource.xenapi.Connection.dispatch(Connection.java:368)
>
> at
> com.cloud.hypervisor.xen.resource.XenServerConnectionPool$XenServerConnection.dispatch(XenServerConnectionPool.java:909)
>
> at com.xensource.xenapi.VBD.unplug(VBD.java:1059)
>
> at
> com.cloud.hypervisor.xen.resource.CitrixResourceBase.handleVmStartFailure(CitrixResourceBase.java:1462)
>
> at
> com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResourceBase.java:1800)
>
> at
> com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:545)
>
> at
> com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:59)
>
> at
> com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:216)
>
> at
> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
>
> at
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
>
> at
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
>
> at
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
>
> at
> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
>
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
>
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
>
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>
> at java.lang.Thread.run(Thread.java:745)
>
> 2014-09-29 16:26:26,138 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-235:ctx-7f8db7ac) The VM is in stopped state, detected problem
> during startup : i-3-98-VM
>
> 2014-09-29 16:26:26,138 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgent-235:ctx-7f8db7ac) Seq 2-868943178: Response Received:
>
> 2014-09-29 16:26:26,141 DEBUG [c.c.a.t.Request]
> (DirectAgent-235:ctx-7f8db7ac) Seq 2-868943178: Processing: { Ans: ,
> MgmtId: 233845174730255, via: 2, Ver: v1, Flags: 10,
> [{"com.cloud.agent.api.StartAnswer":{"vm":{"id":98,"name":"i-3-98-VM","bootloader":"PyGrub","type":"User","cpus":1,"minSpeed":2000,"maxSpeed":2000,"minRam":1782579200,"maxRam":1782579200,"arch":"x86_64","os":"CentOS
> 5.7
> (64-bit)","bootArgs":"","rebootOnCrash":false,"enableHA":false,"limitCpuUse":true,"enableDynamicallyScaleVm":false,"vncPassword":"a19a39dac48334d5","params":{"hypervisortoolsversion":"xenserver56"},"uuid":"c474454f-4772-4479-b9a5-3829c97006e0","disks":[{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"d348a1d2-18ea-4043-b868-18d3cf8ce21f","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"17b0a8a5-2376-3d11-b60e-31eebeafb217","id":202,"poolType":"NetworkFilesystem","host":"172.30.19.1","path":"/export/primary","port":2049,"url":"NetworkFilesystem://
> 172.30.19.1//export/primary/?ROLE=Primary&STOREUUID=17b0a8a5-2376-3d11-b60e-31eebeafb217
> "}},"name":"ROOT-98","size":10737418240,"path":"18801349-c195-468a-99db-67534434d137","volumeId":124,"vmName":"i-3-
> 98-VM
> ","accountId":3,"format":"VHD","id":124,"deviceId":0,"hypervisorType":"XenServer"}},"diskSeq":0,"path":"18801349-c195-468a-99db-67534434d137","type":"ROOT","_details":{"managed":"false","storagePort":"2049","storageHost":"172.30.19.1","volumeSize":"10737418240"}},{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"9d70a3ed-9737-4a34-8a87-048c067deae0","volumeType":"DATADISK","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"17b0a8a5-2376-3d11-b60e-31eebeafb217","id":202,"poolType":"NetworkFilesystem","host":"172.30.19.1","path":"/export/primary","port":2049,"url":"NetworkFilesystem://
> 172.30.19.1//export/primary/?ROLE=Primary&STOREUUID=17b0a8a5-2376-3d11-b60e-31eebeafb217
> "}},"name":"DATA-98","size":5368709120,"path":"a343a4a0-1a7c-45b6-8e64-1e1ed1bdfd48","volumeId":125,"vmName":"i-3-
> 98-VM","accountId":3,"format":"VHD","id":125,"deviceId":1,"hypervisorType":"XenServer"}},"diskSeq":1,"path":"a343a4a0-1a7c-45b6-8e64-1e1ed1bdfd48","type":"DATADISK","_details":{"managed":"false","storagePort":"2049","storageHost":"172.30.19.1","volumeSize":"5368709120"}},{"data":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"id":0,"format":"ISO","accountId":0,"hvm":false}},"diskSeq":3,"type":"ISO"}],"nics":[{"deviceId":0,"networkRateMbps":200,"defaultNic":true,"uuid":"a98bcc83-4cbe-41e3-a992-1bd162883816","ip":"172.30.45.143","netmask":"255.255.255.0","gateway":"172.30.45.1","mac":"06:4f:1e:00:00:41","dns1":"172.30.20.176","dns2":"172.30.20.175","broadcastType":"Vlan","type":"Guest","isSecurityGroupEnabled":false}],"vcpuMaxLimit":16},"_iqnToPath":{},"result":false,"details":"Unable
> to start i-3-98-VM due to ","wait":0}}] }
>
> 2014-09-29 16:26:26,141 DEBUG [c.c.a.t.Request]
> (Job-Executor-24:ctx-38a388ee ctx-b9ffa188) Seq 2-868943178: Received: {
> Ans: , MgmtId: 233845174730255, via: 2, Ver: v1, Flags: 10, { StartAnswer }
> }
>
> 2014-09-29 16:26:26,144 INFO [c.c.v.VirtualMachineManagerImpl]
> (Job-Executor-24:ctx-38a388ee ctx-b9ffa188) Unable to start VM on
> Host[-2-Routing] due to Unable to start i-3-98-VM due to
>
> 2014-09-29 16:26:26,147 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Job-Executor-24:ctx-38a388ee ctx-b9ffa188) Cleaning up resources for the
> vm VM[User|sununxcld19] in Starting state
>
> 2014-09-29 16:26:26,150 DEBUG [c.c.a.t.Request]
> (Job-Executor-24:ctx-38a388ee ctx-b9ffa188) Seq 2-868943180: Sending { Cmd
> , MgmtId: 233845174730255, via: 2(srvengxen02), Ver: v1, Flags: 100011,
> [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"i-3-
> 98-VM","wait":0}}] }
>
> 2014-09-29 16:26:26,150 DEBUG [c.c.a.t.Request]
> (Job-Executor-24:ctx-38a388ee ctx-b9ffa188) Seq 2-868943180: Executing: {
> Cmd , MgmtId: 233845174730255, via: 2(srvengxen02), Ver: v1, Flags: 100011,
> [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"i-3-
> 98-VM","wait":0}}] }
>
> 2014-09-29 16:26:26,150 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgent-236:ctx-234da2e1) Seq 2-868943180: Executing request
>
> 2014-09-29 16:26:26,310 INFO [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-236:ctx-234da2e1) VM does not exist on
> XenServer63befa52-4c03-460a-9557-9100d51cedaf
>
> 2014-09-29 16:26:26,310 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgent-236:ctx-234da2e1) Seq 2-868943180: Response Received:
>
> 2014-09-29 16:26:26,310 DEBUG [c.c.a.t.Request]
> (DirectAgent-236:ctx-234da2e1) Seq 2-868943180: Processing: { Ans: ,
> MgmtId: 233845174730255, via: 2, Ver: v1, Flags: 10,
> [{"com.cloud.agent.api.StopAnswer":{"result":true,"details":"VM does not
> exist","wait":0}}] }
>
> 2014-09-29 16:26:26,310 DEBUG [c.c.a.t.Request]
> (Job-Executor-24:ctx-38a388ee ctx-b9ffa188) Seq 2-868943180: Received: {
> Ans: , MgmtId: 233845174730255, via: 2, Ver: v1, Flags: 10, { StopAnswer } }
>
> 2014-09-29 16:26:26,319 DEBUG [c.c.n.NetworkModelImpl]
> (Job-Executor-24:ctx-38a388ee ctx-b9ffa188) Service SecurityGroup is not
> supported in the network id=204
>
> 2014-09-29 16:26:26,321 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> (Job-Executor-24:ctx-38a388ee ctx-b9ffa188) Changing active number of nics
> for network id=204 on -1
>
> 2014-09-29 16:26:26,326 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> (Job-Executor-24:ctx-38a388ee ctx-b9ffa188) Asking VirtualRouter to release
> NicProfile[127-98-c794b1fc-374c-4d69-a469-5ec708074d02-172.30.45.143-null
>
> 2014-09-29 16:26:26,326 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Job-Executor-24:ctx-38a388ee ctx-b9ffa188) Successfully released network
> resources for the vm VM[User|sununxcld19]
>
> 2014-09-29 16:26:26,326 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Job-Executor-24:ctx-38a388ee ctx-b9ffa188) Successfully cleanued up
> resources for the vm VM[User|sununxcld19] in Starting state
>
> 2014-09-29 16:26:26,330 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Job-Executor-24:ctx-38a388ee ctx-b9ffa188) Root volume is ready, need to
> place VM in volume's cluster
>
>
