Thanks Kelven for the input but I had resolved the issue . I had already copied the vhd-util file since I had set up a brand new xenserver 6.1 host but that wasn't the issue.
The issue was that the systemvm.iso wasn't found in the host and CS tried to use some old template in my primary storage as a reference to create systemVm's. After manually copying the systemvm.iso file to the host and also deleting those stale images on my primary storage and re-deploying the db solved the issue for me . But I still need to figure out why the systemvm.iso wasn't copied over to the host automatically . Probably need to debug the CitrixResourceBase.java file for this. Regards, Pranav -----Original Message----- From: Kelven Yang [mailto:kelven.y...@citrix.com] Sent: Wednesday, March 13, 2013 11:10 PM To: cloudstack-dev@incubator.apache.org Subject: Re: Error starting system vms on latest asf/master Try to copy vhd-util to your XS host at /opt/xensource/bin if your XS host is a brand new setup Kelven On 3/13/13 4:15 AM, "Pranav Saxena" <pranav.sax...@citrix.com> wrote: >$/pranav/incubator-cloudstack# find . -name vhd-util > >./client/target/generated-webapp/WEB-INF/classes/scripts/vm/hypervisor/ >xen >server/vhd-util >./client/target/cloud-client-ui-4.2.0-SNAPSHOT/WEB-INF/classes/scripts/ >vm/ >hypervisor/xenserver/vhd-util >./scripts/vm/hypervisor/xenserver/vhd-util > >-----Original Message----- >From: srivatsav.prasa...@gmail.com >[mailto:srivatsav.prasa...@gmail.com] >On Behalf Of prasanna >Sent: Wednesday, March 13, 2013 4:34 PM >To: cloudstack-dev@incubator.apache.org >Subject: Re: Error starting system vms on latest asf/master > >On 13 March 2013 16:26, Anshul Gangwar <anshul.gang...@citrix.com> wrote: >> I am also getting the same error >> >> Thanks, >> Anshul >> On 13/03/13 16:25, Pranav Saxena wrote: >>> Hi , >>> >>> I tried to deploy latest master code to set up a developer's >>> environment (Ubuntu 12.10 , Xenserver 6.1 ) - >>> >>> >>> 1) mvn -P systemvm clean install (systemvm.iso got created) >>> >>> 2) Deployed the db >>> >>> 3) Started the jetty server >>> >>> The systemvm.iso wasn't found on my host so I tried to manually copy >>> it there but it threw an exception while starting the systemVM's as >>> below - >>> >>> Anybody else seen this error ? Any workarounds ? >>> >>> Thanks, >>> Pranav >>> >>> ____________________________________________________________________ >>> _ >>> ____________________________________________________________________ >>> _ _____________________________________ >>> >>> at java.lang.Thread.run(Thread.java:722) >>> 2013-03-13 15:58:12,837 WARN [xen.resource.CitrixResourceBase] >>>(DirectAgent-2:null) Catch Exception: class >>>com.cloud.utils.exception.CloudRuntimeException due to >>>com.cloud.utils.exception.CloudRuntimeException: Unable to start >>>VM(s-42-VM) on host(0d014dbd-f2e8-47e1-807d-5fb0e5a59fa1) due to Task >>>failed! Task record: uuid: >>>702df462-1c78-a76e-ab02-513bb2523c4a >>> nameLabel: Async.VM.start_on >>> nameDescription: >>> allowedOperations: [] >>> currentOperations: {} >>> created: Wed Mar 13 16:00:13 IST 2013 >>> finished: Wed Mar 13 16:00:15 IST 2013 >>> status: failure >>> residentOn: com.xensource.xenapi.Host@c460e443 >>> progress: 1.0 >>> type: <none/> >>> result: >>> errorInfo: [INTERNAL_ERROR, xenopsd internal error: VM = >>>cf8b3190-3d6e-f7df-f328-43fe1ff1f504; domid = 2; Bootloader.Bad_error >>>Traceback (most recent call last): >>> File "/usr/bin/pygrub", line 900, in ? >>> fs = fsimage.open(file, part_offs[0], bootfsoptions) >>> IOError: [Errno 95] Operation not supported ] >>> otherConfig: {} >>> subtaskOf: com.xensource.xenapi.Task@aaf13f6f >>> subtasks: [] >>> >>> com.cloud.utils.exception.CloudRuntimeException: Unable to start >>>VM(s-42-VM) on host(0d014dbd-f2e8-47e1-807d-5fb0e5a59fa1) due to Task >>>failed! Task record: uuid: >>>702df462-1c78-a76e-ab02-513bb2523c4a >>> nameLabel: Async.VM.start_on >>> nameDescription: >>> allowedOperations: [] >>> currentOperations: {} >>> created: Wed Mar 13 16:00:13 IST 2013 >>> finished: Wed Mar 13 16:00:15 IST 2013 >>> status: failure >>> residentOn: com.xensource.xenapi.Host@c460e443 >>> progress: 1.0 >>> type: <none/> >>> result: >>> errorInfo: [INTERNAL_ERROR, xenopsd internal error: VM = >>>cf8b3190-3d6e-f7df-f328-43fe1ff1f504; domid = 2; Bootloader.Bad_error >>>Traceback (most recent call last): >>> File "/usr/bin/pygrub", line 900, in ? >>> fs = fsimage.open(file, part_offs[0], bootfsoptions) >>> IOError: [Errno 95] Operation not supported ] >>> otherConfig: {} >>> subtaskOf: com.xensource.xenapi.Task@aaf13f6f >>> subtasks: [] >>> >>> at >>>com.cloud.hypervisor.xen.resource.CitrixResourceBase.startVM(CitrixRe >>>sou >>>rceBase.java:3424) >>> at >>>com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixRe >>>sou >>>rceBase.java:1427) >>> at >>>com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(C >>>itr >>>ixResourceBase.java:530) >>> at >>>com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest( >>>Xen >>>Server56Resource.java:73) >>> at >>>com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttach >>>e.j >>>ava:186) >>> at >>>java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) >>> at >>>java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) >>> at >>>java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) >>> at java.util.concurrent.FutureTask.run(FutureTask.java:166) >>> at >>>java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask. >>>acc >>>ess$201(ScheduledThreadPoolExecutor.java:178) >>> at >>>java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask. >>>run >>>(ScheduledThreadPoolExecutor.java:292) >>> at >>>java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor. >>>jav >>>a:1110) >>> at >>>java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor >>>.ja >>>va:603) >>> at java.lang.Thread.run(Thread.java:722) >>> 2013-03-13 15:58:12,838 WARN [xen.resource.CitrixResourceBase] >>>(DirectAgent-2:null) Unable to start s-42-VM due to >>> com.cloud.utils.exception.CloudRuntimeException: Unable to start >>>VM(s-42-VM) on host(0d014dbd-f2e8-47e1-807d-5fb0e5a59fa1) due to Task >>>failed! Task record: uuid: >>>702df462-1c78-a76e-ab02-513bb2523c4a >>> nameLabel: Async.VM.start_on >>> nameDescription: >>> allowedOperations: [] >>> currentOperations: {} >>> created: Wed Mar 13 16:00:13 IST 2013 >>> finished: Wed Mar 13 16:00:15 IST 2013 >>> status: failure >>> residentOn: com.xensource.xenapi.Host@c460e443 >>> progress: 1.0 >>> type: <none/> >>> result: >>> errorInfo: [INTERNAL_ERROR, xenopsd internal error: VM = >>>cf8b3190-3d6e-f7df-f328-43fe1ff1f504; domid = 2; Bootloader.Bad_error >>>Traceback (most recent call last): >>> File "/usr/bin/pygrub", line 900, in ? >>> fs = fsimage.open(file, part_offs[0], bootfsoptions) >>> IOError: [Errno 95] Operation not supported ] >>> otherConfig: {} >>> subtaskOf: com.xensource.xenapi.Task@aaf13f6f >>> subtasks: [] >>> >>> at >>>com.cloud.hypervisor.xen.resource.CitrixResourceBase.startVM(CitrixRe >>>sou >>>rceBase.java:3424) >>> at >>>com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixRe >>>sou >>>rceBase.java:1427) >>> at >>>com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(C >>>itr >>>ixResourceBase.java:530) >>> at >>>com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest( >>>Xen >>>Server56Resource.java:73) >>> at >>>com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttach >>>e.j >>>ava:186) >>> at >>>java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) >>> at >>>java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) >>> at java.util.concurrent.FutureTask.run(FutureTask.java:166) >>> at >>>java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask. >>>acc >>>ess$201(ScheduledThreadPoolExecutor.java:178) >>> at >>>java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask. >>>run >>>(ScheduledThreadPoolExecutor.java:292) >>> at >>>java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor. >>>jav >>>a:1110) >>> at >>>java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor >>>.ja >>>va:603) >>> at java.lang.Thread.run(Thread.java:722) >>> 2013-03-13 15:58:12,978 WARN [xen.resource.CitrixResourceBase] >>> (DirectAgent-2:null) Unable to clean up VBD due to You gave an >>>invalid object reference. The object may have recently been deleted. >>>The class parameter gives the type of reference given, and the handle >>>parameter echoes the bad value given. >>> at com.xensource.xenapi.Types.checkResponse(Types.java:209) >>> at >>>com.xensource.xenapi.Connection.dispatch(Connection.java:368) >>> at >>>com.cloud.hypervisor.xen.resource.XenServerConnectionPool$XenServerCo >>>nne >>>ction.dispatch(XenServerConnectionPool.java:909) >>> at com.xensource.xenapi.VBD.unplug(VBD.java:1059) >>> >>> >>> > >~/incubator-cloudstack$ find . -name vhd-util -type f?