David - Thanks for the help. The issue ended up being due to the nfs v4 Domain.
-- James -----Original Message----- From: Boylan, James [mailto:james.boy...@orbitz.com] Sent: Tuesday, November 20, 2012 12:40 PM To: 'cloudstack-users@incubator.apache.org' Subject: Re: Libvirt errors preventing System VMs from being created That is all detailed in the original message in the thread except that its Centos 6.3. James T. Boylan Senior Systems Engineer Site Reliability Engineering Orbitz WorldWide Office (312) 260-2378 Cell (312) 863-9134 james.boy...@orbitz.com -- Sent from Blackberry -- ----- Original Message ----- From: Edison Su [mailto:edison...@citrix.com] Sent: Tuesday, November 20, 2012 12:33 PM To: cloudstack-users@incubator.apache.org <cloudstack-users@incubator.apache.org> Subject: RE: Libvirt errors preventing System VMs from being created Could you follow the link(https://cwiki.apache.org/CLOUDSTACK/kvm-agent-debug.html): Which KVM host os is using? Centos 6.2, 6,1, Ubuntu 10.04? Which version of libvirt is using, "virsh --version" turn the agent log level to debug: sed -i 's/INFO/DEBUG/g' /etc/cloud/agent/log4j-cloud.xml Then reproduce the issue, and take a look at agent.log. > -----Original Message----- > From: Boylan, James [mailto:james.boy...@orbitz.com] > Sent: Tuesday, November 20, 2012 8:30 AM > To: cloudstack-users@incubator.apache.org > Subject: Libvirt errors preventing System VMs from being created > > I'm having an issue with a new install of Cloudstack and would > appreciate any help on this. > > Everything is configured, but when it tries to start the initial > System VMs I get the following errors. > > management-server.log: > --------------------------------------------- > 2012-11-20 09:43:17,021 WARN > [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) > Exception while trying to start secondary storage vm > com.cloud.exception.AgentUnavailableException: Resource [Host:1] is > unreachable: Host 1: Unable to start instance due to Unable to get > answer that is of class com.cloud.agent.api.StartAnswer > at > com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineMa > nagerImpl.java:847) > at > com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerIm > pl.java:472) > at > com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerIm > pl.java:465) > at > com.cloud.storage.secondary.SecondaryStorageManagerImpl.startSecStorag > eVm(SecondaryStorageManagerImpl.java:257) > at > com.cloud.storage.secondary.SecondaryStorageManagerImpl.allocCapacity( > SecondaryStorageManagerImpl.java:684) > at > com.cloud.storage.secondary.SecondaryStorageManagerImpl.expandPool(S > econdaryStorageManagerImpl.java:1310) > at > com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(Pre > miumSecondaryStorageManagerImpl.java:119) > at > com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(Pre > miumSecondaryStorageManagerImpl.java:50) > at > com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java > :106) > at > com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.ja > va:34) > at > com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.j > ava:83) > at > com.cloud.vm.SystemVmLoadScanner$1.run(SystemVmLoadScanner.java:73 > ) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at > java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java: > 35 > 1) > at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178) > at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.a > c > cess$201(ScheduledThreadPoolExecutor.java:165) > at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.r > u > n(ScheduledThreadPoolExecutor.java:267) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.j > av > a:1110) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor. > ja > va:603) > at java.lang.Thread.run(Thread.java:679) > Caused by: com.cloud.utils.exception.CloudRuntimeException: Unable to > get answer that is of class com.cloud.agent.api.StartAnswer > at com.cloud.agent.manager.Commands.getAnswer(Commands.java:80) > at > com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineMa > nagerImpl.java:783) > ... 20 more > agent.log: > --------------------------------------------- > 2012-11-20 09:38:32,016 WARN [kvm.resource.LibvirtComputingResource] > (agentRequest-Handler-5:null) Exception > com.cloud.utils.exception.CloudRuntimeException: > org.libvirt.LibvirtException: cannot create path > '/mnt/0e6f9c16-6a1a-3536- > 9460-8ce14d494596/v-2-VM-patchdisk': Invalid argument > at > com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.createPhysicalD > isk > (LibvirtStorageAdaptor.java:556) > at > com.cloud.hypervisor.kvm.storage.LibvirtStoragePool.createPhysicalDisk > (Lib > virtStoragePool.java:101) > at > com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.createPatch > Vbd(LibvirtComputingResource.java:2980) > at > com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.createVbd(L > i > bvirtComputingResource.java:2943) > at > com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(Lib > v > irtComputingResource.java:2808) > at > com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeReq > uest(LibvirtComputingResource.java:1035) > at com.cloud.agent.Agent.processRequest(Agent.java:518) > at > com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:831) > at com.cloud.utils.nio.Task.run(Task.java:83) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.j > av > a:1110) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor. > ja > va:603) > at java.lang.Thread.run(Thread.java:679) > 2012-11-20 09:38:32,023 WARN [cloud.agent.Agent] > (agentRequest-Handler- > 5:null) Caught: > java.lang.NullPointerException > at > com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.cleanupVMN > etworks(LibvirtComputingResource.java:3922) > at > com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.handleVmSt > artFailure(LibvirtComputingResource.java:2709) > at > com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(Lib > v > irtComputingResource.java:2834) > at > com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeReq > uest(LibvirtComputingResource.java:1035) > at com.cloud.agent.Agent.processRequest(Agent.java:518) > at > com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:831) > at com.cloud.utils.nio.Task.run(Task.java:83) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.j > av > a:1110) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor. > ja > va:603) > at java.lang.Thread.run(Thread.java:679) > > libvirtd: > --------------------------------------------- > 2012-11-20 15:43:16.627+0000: 41665: error : > virStorageBackendCreateRaw:401 : cannot create path > '/mnt/0e6f9c16-6a1a- > 3536-9460-8ce14d494596/s-3-VM-patchdisk': Invalid argument > 2012-11-20 15:43:16.627+0000: 41665: error : > virStorageBackendCreateRaw:401 : cannot create path > '/mnt/0e6f9c16-6a1a- > 3536-9460-8ce14d494596/s-3-VM-patchdisk': Invalid argument > 2012-11-20 15:43:16.720+0000: 41667: error : > virFileOpenForceOwnerMode:795 : cannot chown '/mnt/0e6f9c16-6a1a- > 3536-9460-8ce14d494596/v-2-VM-patchdisk' to (0, 0): Invalid argument > 2012-11-20 15:43:16.720+0000: 41667: error : > virFileOpenForceOwnerMode:795 : cannot chown '/mnt/0e6f9c16-6a1a- > 3536-9460-8ce14d494596/v-2-VM-patchdisk' to (0, 0): Invalid argument > 2012-11-20 15:43:16.720+0000: 41667: error : > virFileOpenForceOwnerMode:795 : cannot chown '/mnt/0e6f9c16-6a1a- > 3536-9460-8ce14d494596/v-2-VM-patchdisk' to (0, 0): Invalid argument > 2012-11-20 15:43:16.720+0000: 41667: error : > virFileOpenForceOwnerMode:795 : cannot chown '/mnt/0e6f9c16-6a1a- > 3536-9460-8ce14d494596/v-2-VM-patchdisk' to (0, 0): Invalid argument > 2012-11-20 15:43:16.720+0000: 41667: error : > virStorageBackendCreateRaw:401 : cannot create path > '/mnt/0e6f9c16-6a1a- > 3536-9460-8ce14d494596/v-2-VM-patchdisk': Invalid argument > 2012-11-20 15:43:16.720+0000: 41667: error : > virStorageBackendCreateRaw:401 : cannot create path > '/mnt/0e6f9c16-6a1a- > 3536-9460-8ce14d494596/v-2-VM-patchdisk': Invalid argument > 2012-11-20 15:43:16.720+0000: 41667: error : > virStorageBackendCreateRaw:401 : cannot create path > '/mnt/0e6f9c16-6a1a- > 3536-9460-8ce14d494596/v-2-VM-patchdisk': Invalid argument > 2012-11-20 15:43:16.720+0000: 41667: error : > virStorageBackendCreateRaw:401 : cannot create path > '/mnt/0e6f9c16-6a1a- > 3536-9460-8ce14d494596/v-2-VM-patchdisk': Invalid argument > > -- James
