Hi Ahmad,
Thanks for you great input that got me one step further. I had
system.vm.use.local.storage set to true but use.local.storage was still on
false. After setting the later to true I got pass the previous error message
and I was able to see system VMs could pick up a public , private and link
local IP address. However the state of my system VMs stays on Starting and goes
back to Stopped after a while. Below is the error part of the CMS log. Any
Suggestions?...
2013-02-27 10:42:41,636 DEBUG [agent.transport.Request]
(AgentManager-Handler-6:null) Seq 5-1496055849: Processing: { Ans: , MgmtId:
16279293006507, via: 5, Ver: v1, Flags: 110,
[{"StartAnswer":{"vm":{"id":1423,"name":"v-1423-VM","type":"ConsoleProxy","cpus":1,"speed":500,"minRam":1073741824,"maxRam":1073741824,"arch":"x86_64","os":"Debian
GNU/Linux 5.0 (32-bit)","bootArgs":" template=domP type=consoleproxy
host=10.26.0.90 port=8250 name=v-1423-VM premium=true zone=4 pod=4
guid=Proxy.1423 proxy_vm=1423 disable_rp_filter=true eth2ip=172.18.1.11
eth2mask=255.255.0.0 gateway=172.18.1.1 eth0ip=169.254.1.117
eth0mask=255.255.0.0 eth1ip=10.26.0.134 eth1mask=255.255.0.0
mgmtcidr=10.26.0.0/16 localgw=10.26.0.1 internaldns1=10.26.0.160
internaldns2=8.8.8.8 dns1=10.26.0.160
dns2=8.8.8.8","rebootOnCrash":false,"enableHA":false,"limitCpuUse":false,"vncPassword":"3d03cc1bad8ede6b","params":{},"disks":[{"id":1423,"name":"ROOT-1423","mountPoint":"/var/lib/libvirt/images/","path":"706fda6a-0dcc-4ba2-8ff0-63a5fd0214a5","size":139264,"type":"ROOT","storagePoolType":"Filesystem","storagePoolUuid":"417c7db1-2249-49e8-949f-3bd681cdc0cd","deviceId":0}],"nics":[{"deviceId":2,"networkRateMbps":-1,"defaultNic":true,"ip":"172.18.1.11","netmask":"255.255.0.0","gateway":"172.18.1.1","mac":"06:be:2e:00:00:0d","dns1":"10.26.0.160","dns2":"8.8.8.8","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://1","isolationUri":"vlan://1","isSecurityGroupEnabled":false},{"deviceId":0,"networkRateMbps":-1,"defaultNic":false,"ip":"169.254.1.117","netmask":"255.255.0.0","gateway":"169.254.0.1","mac":"0e:00:a9:fe:01:75","broadcastType":"LinkLocal","type":"Control","isSecurityGroupEnabled":false},{"deviceId":1,"networkRateMbps":-1,"defaultNic":false,"ip":"10.26.0.134","netmask":"255.255.0.0","gateway":"10.26.0.1","mac":"06:ee:c2:00:00:05","broadcastType":"Native","type":"Management","isSecurityGroupEnabled":false}]},"result":false,"details":"Failed
to create vnet 1: java.lang.NullPointerException\n\tat
java.lang.ProcessBuilder.start(ProcessBuilder.java:457)\n\tat
com.cloud.utils.script.Script.execute(Script.java:177)\n\tat
com.cloud.utils.script.Script.execute(Script.java:155)\n\tat
com.cloud.agent.resource.computing.LibvirtComputingResource.createVnet(LibvirtComputingResource.java:2112)\n\tat
com.cloud.agent.resource.computing.LibvirtComputingResource.createVlanBr(LibvirtComputingResource.java:2692)\n\tat
com.cloud.agent.resource.computing.LibvirtComputingResource.createVif(LibvirtComputingResource.java:2726)\n\tat
com.cloud.agent.resource.computing.LibvirtComputingResource.createVif(LibvirtComputingResource.java:2744)\n\tat
com.cloud.agent.resource.computing.LibvirtComputingResource.createVifs(LibvirtComputingResource.java:2489)\n\tat
com.cloud.agent.resource.computing.LibvirtComputingResource.execute(LibvirtComputingResource.java:2512)\n\tat
com.cloud.agent.resource.computing.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:985)\n\tat
com.cloud.agent.Agent.processRequest(Agent.java:517)\n\tat
com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:827)\n\tat
com.cloud.utils.nio.Task.run(Task.java:79)\n\tat
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)\n\tat
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)\n\tat
java.lang.Thread.run(Thread.java:679)\n","wait":0}},{"Answer":{"result":false,"details":"Stopped
by previous failure","wait":0}}] }
2013-02-27 10:42:41,636 WARN [cloud.vm.VirtualMachineManagerImpl]
(consoleproxy-1:null) Cleanup failed due to Failed to create vnet 1:
java.lang.NullPointerException
2013-02-27 10:42:41,637 WARN [cloud.vm.VirtualMachineManagerImpl]
(consoleproxy-1:null) Cleanup failed due to Stopped by previous failure
2013-02-27 10:42:41,638 WARN [cloud.vm.VirtualMachineManagerImpl]
(AgentManager-Handler-6:null) Cleanup failed due to Failed to create vnet 1:
java.lang.NullPointerException
2013-02-27 10:42:41,639 WARN [cloud.vm.VirtualMachineManagerImpl]
(AgentManager-Handler-6:null) Cleanup failed due to Stopped by previous failure
2013-02-27 10:42:41,644 INFO [cloud.vm.VirtualMachineManagerImpl]
(consoleproxy-1:null) Unable to start VM on Host[-5-Routing] due to Failed to
create vnet 1: java.lang.NullPointerException
[root@cms ~]#
-----Original Message-----
From: Ahmad Emneina [mailto:aemne...@gmail.com]
Sent: 26 February 2013 19:15
To: Cloudstack users
Subject: Re: StoragePool is not of correct type
2013-02-26 17:01:58,147 DEBUG [storage.allocator.AbstractStoragePoolAllocator]
(consoleproxy-1:null) Is storage pool shared? true
2013-02-26 17:01:58,147 DEBUG [storage.allocator.AbstractStoragePoolAllocator]
(consoleproxy-1:null) StoragePool is not of correct type, skipping this pool
this might be your issue. are your system vm's set to use local storage?
On Tue, Feb 26, 2013 at 9:04 AM, Valery Fongang <
fongang.val...@pertechtual.net> wrote:
> Hi all,****
>
> ** **
>
> I am trying to setup Cloudstack 3.0.2 with KVM hypervisor (on Centos
> 3.0) and I am running into a number of issues. At this time I have
> managed to get up to the following stage:****
>
> ** **
>
> **- **Cloud Management Server installed.****
>
> **- **Host installed with KVM.****
>
> **- **Zone-Cluster-Pod-Host-Primary Storage- Secondary all setup
> and displaying on Cloudstack dashboard.****
>
> **- **System VM templates are available in Templates but no
> Centos Template.****
>
> **- **System VMs were generated but unable to boot.****
>
> **- **My Cloud Management Server Log shows the following:****
>
> ** **
>
> ** **
>
> 2013-02-26 17:01:58,119 DEBUG [cloud.capacity.CapacityManagerImpl]
> (consoleproxy-1:null) VM state transitted from :Stopped to Starting
> with
> event: StartRequestedvm's original host id: null new host id: null
> host id before state transition: null****
>
> 2013-02-26 17:01:58,119 DEBUG [cloud.vm.VirtualMachineManagerImpl]
> (consoleproxy-1:null) Successfully transitioned to start state for
> VM[ConsoleProxy|v-1423-VM] reservation id =
> a2d3825d-ffc7-411c-92ec-fc0872247923****
>
> 2013-02-26 17:01:58,127 DEBUG [cloud.vm.VirtualMachineManagerImpl]
> (consoleproxy-1:null) Trying to deploy VM, vm has dcId: 4 and podId:
> null*
> ***
>
> 2013-02-26 17:01:58,128 DEBUG [cloud.vm.VirtualMachineManagerImpl]
> (consoleproxy-1:null) Deploy avoids pods: null, clusters: null, hosts:
> null
> ****
>
> 2013-02-26 17:01:58,129 DEBUG [cloud.deploy.FirstFitPlanner]
> (consoleproxy-1:null) DeploymentPlanner allocation algorithm:
> random****
>
> 2013-02-26 17:01:58,129 DEBUG [cloud.deploy.FirstFitPlanner]
> (consoleproxy-1:null) Trying to allocate a host and storage pools from
> dc:4, pod:null,cluster:null, requested cpu: 500, requested ram:
> 1073741824
> ****
>
> 2013-02-26 17:01:58,129 DEBUG [cloud.deploy.FirstFitPlanner]
> (consoleproxy-1:null) Is ROOT volume READY (pool already allocated)?:
> No**
> **
>
> 2013-02-26 17:01:58,129 DEBUG [cloud.deploy.FirstFitPlanner]
> (consoleproxy-1:null) Searching all possible resources under this
> Zone: 4*
> ***
>
> 2013-02-26 17:01:58,130 DEBUG [cloud.deploy.FirstFitPlanner]
> (consoleproxy-1:null) Listing clusters in order of aggregate capacity,
> that have (atleast one host with) enough CPU and RAM capacity under
> this Zone: 4
> ****
>
> 2013-02-26 17:01:58,130 DEBUG [cloud.deploy.FirstFitPlanner]
> (consoleproxy-1:null) CPUOverprovisioningFactor considered: 1.0****
>
> 2013-02-26 17:01:58,139 DEBUG [cloud.deploy.FirstFitPlanner]
> (consoleproxy-1:null) Checking resources in Cluster: 4 under Pod:
> 4****
>
> 2013-02-26 17:01:58,139 DEBUG [cloud.deploy.FirstFitPlanner]
> (consoleproxy-1:null) Calling HostAllocators to find suitable
> hosts****
>
> 2013-02-26 17:01:58,139 DEBUG [allocator.impl.FirstFitAllocator]
> (consoleproxy-1:FirstFitRoutingAllocator) Looking for hosts in dc: 4
> pod:4 cluster:4****
>
> 2013-02-26 17:01:58,141 DEBUG [allocator.impl.FirstFitAllocator]
> (consoleproxy-1:FirstFitRoutingAllocator) FirstFitAllocator has 1
> hosts to check for allocation: [Host[-5-Routing]]****
>
> 2013-02-26 17:01:58,142 DEBUG [allocator.impl.FirstFitAllocator]
> (consoleproxy-1:FirstFitRoutingAllocator) Found 1 hosts for allocation
> after prioritization: [Host[-5-Routing]]****
>
> 2013-02-26 17:01:58,142 DEBUG [allocator.impl.FirstFitAllocator]
> (consoleproxy-1:FirstFitRoutingAllocator) Looking for speed=500Mhz,
> Ram=1024
> ****
>
> 2013-02-26 17:01:58,143 DEBUG [cloud.capacity.CapacityManagerImpl]
> (consoleproxy-1:FirstFitRoutingAllocator) Checking if host: 5 has
> enough capacity for requested CPU: 500 and requested RAM: 1073741824 ,
> cpuOverprovisioningFactor: 1.0****
>
> 2013-02-26 17:01:58,145 DEBUG [cloud.capacity.CapacityManagerImpl]
> (consoleproxy-1:FirstFitRoutingAllocator) Hosts's actual total CPU:
> 28920 and CPU after applying overprovisioning: 28920****
>
> 2013-02-26 17:01:58,145 DEBUG [cloud.capacity.CapacityManagerImpl]
> (consoleproxy-1:FirstFitRoutingAllocator) Free CPU: 28920 , Requested CPU:
> 500****
>
> 2013-02-26 17:01:58,145 DEBUG [cloud.capacity.CapacityManagerImpl]
> (consoleproxy-1:FirstFitRoutingAllocator) Free RAM: 24914546688 ,
> Requested
> RAM: 1073741824****
>
> 2013-02-26 17:01:58,145 DEBUG [cloud.capacity.CapacityManagerImpl]
> (consoleproxy-1:FirstFitRoutingAllocator) Host has enough CPU and RAM
> available****
>
> 2013-02-26 17:01:58,145 DEBUG [cloud.capacity.CapacityManagerImpl]
> (consoleproxy-1:FirstFitRoutingAllocator) STATS: Can alloc CPU from host:
> 5, used: 0, reserved: 0, actual total: 28920, total with overprovisioning:
> 28920; requested cpu:500,alloc_from_last_host?:false
> ,considerReservedCapacity?: true****
>
> 2013-02-26 17:01:58,145 DEBUG [cloud.capacity.CapacityManagerImpl]
> (consoleproxy-1:FirstFitRoutingAllocator) STATS: Can alloc MEM from host:
> 5, used: 0, reserved: 0, total: 24914546688; requested mem:
> 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?:
> true***
> *
>
> 2013-02-26 17:01:58,145 DEBUG [allocator.impl.FirstFitAllocator]
> (consoleproxy-1:FirstFitRoutingAllocator) Found a suitable host,
> adding to
> list: 5****
>
> 2013-02-26 17:01:58,145 DEBUG [allocator.impl.FirstFitAllocator]
> (consoleproxy-1:FirstFitRoutingAllocator) Host Allocator returning 1
> suitable hosts****
>
> 2013-02-26 17:01:58,146 DEBUG [cloud.deploy.FirstFitPlanner]
> (consoleproxy-1:null) Checking suitable pools for volume (Id, Type):
> (1423,ROOT)****
>
> 2013-02-26 17:01:58,146 DEBUG [cloud.deploy.FirstFitPlanner]
> (consoleproxy-1:null) We need to allocate new storagepool for this
> volume*
> ***
>
> 2013-02-26 17:01:58,146 DEBUG [cloud.deploy.FirstFitPlanner]
> (consoleproxy-1:null) Calling StoragePoolAllocators to find suitable
> pools
> ****
>
> 2013-02-26 17:01:58,146 DEBUG
> [storage.allocator.LocalStoragePoolAllocator] (consoleproxy-1:null)
> LocalStoragePoolAllocator trying to find storage pool to fit the
> vm****
>
> 2013-02-26 17:01:58,146 DEBUG
> [storage.allocator.FirstFitStoragePoolAllocator] (consoleproxy-1:null)
> Looking for pools in dc: 4 pod:4 cluster:4****
>
> 2013-02-26 17:01:58,147 DEBUG
> [storage.allocator.FirstFitStoragePoolAllocator] (consoleproxy-1:null)
> FirstFitStoragePoolAllocator has 1 pools to check for allocation****
>
> 2013-02-26 17:01:58,147 DEBUG
> [storage.allocator.AbstractStoragePoolAllocator] (consoleproxy-1:null)
> Checking if storage pool is suitable, name: PRIMARY ,poolId: 224****
>
> 2013-02-26 17:01:58,147 DEBUG
> [storage.allocator.AbstractStoragePoolAllocator] (consoleproxy-1:null)
> Is localStorageAllocationNeeded? true****
>
> 2013-02-26 17:01:58,147 DEBUG
> [storage.allocator.AbstractStoragePoolAllocator] (consoleproxy-1:null)
> Is storage pool shared? true****
>
> 2013-02-26 17:01:58,147 DEBUG
> [storage.allocator.AbstractStoragePoolAllocator] (consoleproxy-1:null)
> StoragePool is not of correct type, skipping this pool****
>
> 2013-02-26 17:01:58,147 DEBUG
> [storage.allocator.FirstFitStoragePoolAllocator] (consoleproxy-1:null)
> FirstFitStoragePoolAllocator returning 0 suitable storage pools****
>
> 2013-02-26 17:01:58,147 DEBUG
> [storage.allocator.LocalStoragePoolAllocator] (consoleproxy-1:null)
> LocalStoragePoolAllocator returning 0 suitable storage pools****
>
> 2013-02-26 17:01:58,147 DEBUG
> [storage.allocator.LocalStoragePoolAllocator] (consoleproxy-1:null)
> Unable to find storage pool to fit the vm****
>
> 2013-02-26 17:01:58,147 DEBUG [cloud.deploy.FirstFitPlanner]
> (consoleproxy-1:null) No suitable pools found for volume:
> Vol[1423|vm=1423|ROOT] under cluster: 4****
>
> 2013-02-26 17:01:58,147 DEBUG [cloud.deploy.FirstFitPlanner]
> (consoleproxy-1:null) No suitable pools found****
>
> 2013-02-26 17:01:58,147 DEBUG [cloud.deploy.FirstFitPlanner]
> (consoleproxy-1:null) No suitable storagePools found under this
> Cluster: 4
> ****
>
> 2013-02-26 17:01:58,147 DEBUG [cloud.deploy.FirstFitPlanner]
> (consoleproxy-1:null) Could not find suitable Deployment Destination
> for this VM under any clusters, returning.****
>
> 2013-02-26 17:01:58,165 DEBUG [cloud.capacity.CapacityManagerImpl]
> (consoleproxy-1:null) VM state transitted from :Starting to Stopped
> with
> event: OperationFailedvm's original host id: null new host id: null
> host id before state transition: null****
>
> 2013-02-26 17:01:58,166 WARN
> [cloud.consoleproxy.ConsoleProxyManagerImpl]
> (consoleproxy-1:null) Exception while trying to start console
> proxy****
>
> com.cloud.exception.InsufficientServerCapacityException: Unable to
> create a deployment for VM[ConsoleProxy|v-1423-VM]Scope=interface
> com.cloud.dc.DataCenter; id=4****
>
> at
> com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineMana
> gerImpl.java:723)
> ****
>
> at
> com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl
> .java:461)
> ****
>
> at
> com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl
> .java:454)
> ****
>
> at
> com.cloud.consoleproxy.ConsoleProxyManagerImpl.startProxy(ConsoleProxy
> ManagerImpl.java:598)
> ****
>
> at
> com.cloud.consoleproxy.ConsoleProxyManagerImpl.allocCapacity(ConsolePr
> oxyManagerImpl.java:1096)
> ****
>
> at
> com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxy
> ManagerImpl.java:1869)
> ****
>
> at
> com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxy
> ManagerImpl.java:155)
> ****
>
> at
> com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:109
> )***
> *
>
> at
> com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:3
> 0)**
> **
>
> at
> com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:
> 79)*
> ***
>
> at
> com.cloud.vm.SystemVmLoadScanner$1.run(SystemVmLoadScanner.java:69)*
> ***
>
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471
> )***
> *
>
> at
> java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:
> 351)
> ****
>
> at
> java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178)****
>
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.a
> ccess$201(ScheduledThreadPoolExecutor.java:165)
> ****
>
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.r
> un(ScheduledThreadPoolExecutor.java:267)
> ****
>
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.j
> ava:1110)
> ****
>
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.
> java:603)
> ****
>
> at java.lang.Thread.run(Thread.java:679)****
>
> 2013-02-26 17:01:58,468 DEBUG
> [network.router.VirtualNetworkApplianceManagerImpl]
> (RouterStatusMonitor-1:null) Found 0 routers.****
>
> 2013-02-26 17:02:00,013 DEBUG [agent.manager.AgentManagerImpl]
> (AgentManager-Handler-7:null) Ping from 5****
>
> ** **
>
> ** **
>
> Can someone give me an idea on how to solve this issue?...****
>
> ** **
>
> **- ******
>
