Hello, I have gotten it to work! I discovered that Amazon RDS was using mysql-server version 5.6.
I created a new DB instance using version 5.1.73 and the system vms now start up! ________________________________________ From: Marty J. Sullivan <[email protected]> Sent: Sunday, August 24, 2014 3:11 PM To: [email protected] Subject: SSVM cannot be created on 4.4 fresh install: "Unable to create deployment, no usable volumes found for the VM" Hello, I am becoming quite frustrated because I have gone through the cloudstack 4.4 setup about a dozen times with the same result. I am creating a single management server/KVM host; the cloudstack host is running CentOS 6.5. The primary and secondary storage are on two separate hosts running CentOS 7. I have followed the installation instructions exactly and every time the management server cannot create the system VM's. I have taken the following steps: - Set up mysql on Amazon RDS, running cloudstack-setup-databases command works fine. - Set up a single NIC on the cloudstack host with one IP Address in the same subnet, but outside the ranges used for internal/guest networks. - Created NFS shares on two hosts, one primary one secondary. Can mount both shares fine on the Management/KVM host and can write to both shares. I unmount the shares before starting install as it says in the instructions. - I put all three hosts on the same /25 subnet, using different ranges for internal/public networks - I've seeded the systemvm template for KVM to the secondary storage - I use the IP Addresses for the two storage hosts in the storage setup Everything sets up fine but when the setup gets to the point of creating the system vm's, it starts throwing the following exceptions: 2014-08-24 15:04:13,389 DEBUG [c.c.s.StatsCollector] (StatsCollector-3:ctx-8dd20a54) There is no secondary storage VM for secondary storage host nfs://xxx.xxx.xxx.xxx/pool/secondary 2014-08-24 15:04:13,437 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-94c4ec96) Allocating nics for VM[SecondaryStorageVm|s-29-VM] 2014-08-24 15:04:13,511 DEBUG [c.c.a.t.Request] (StatsCollector-3:ctx-8dd20a54) Seq 1-7039407692556795967: Received: { Ans: , MgmtId: 161331704522, via: 1, Ver: v1, Flags: 10, { GetStorageStatsAnswer } } 2014-08-24 15:04:13,537 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-94c4ec96) Allocating nic for vm VM[SecondaryStorageVm|s-29-VM] in network Ntwk[724c54c5-307c-40d1-91cb-96884d297f6e|Guest|6] with requested profile NicProfile[0-0-null-null-null 2014-08-24 15:04:13,696 DEBUG [c.c.u.d.T.Transaction] (secstorage-1:ctx-94c4ec96) Rolling back the transaction: Time = 258 Name = secstorage-1; called by -TransactionLegacy.rollback:903-TransactionLegacy.removeUpTo:846-TransactionLegacy.close:670-TransactionContextInterceptor.invoke:36-ReflectiveMethodInvocation.proceed:161-ExposeInvocationInterceptor.invoke:91-ReflectiveMethodInvocation.proceed:172-JdkDynamicAopProxy.invoke:204-$Proxy54.persist:-1-NetworkOrchestrator.allocateNic:821-NetworkOrchestrator$3.doInTransactionWithoutResult:748-TransactionCallbackWithExceptionNoReturn.doInTransaction:25 2014-08-24 15:04:13,701 DEBUG [c.c.a.ApiServlet] (catalina-exec-2:ctx-01698f22) ===START=== 128.84.34.189 -- GET command=listSystemVms&response=json&sessionkey=pYysvRh9kluVHYYsTC4BihvYJq4%3D&_=1408907056311 2014-08-24 15:04:13,760 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-108:ctx-3db552df job-1/job-117 ctx-78ff9836) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: null 2014-08-24 15:04:13,791 WARN [c.c.v.SystemVmLoadScanner] (secstorage-1:ctx-94c4ec96) Unexpected exception DB Exception on: com.mysql.jdbc.JDBC4PreparedStatement@6d760c36: INSERT INTO nics (nics.instance_id, nics.ip4_address, nics.ip6_address, nics.netmask, nics.isolation_uri, nics.ip_type, nics.broadcast_uri, nics.gateway, nics.mac_address, nics.mode, nics.network_id, nics.state, nics.reserver_name, nics.reservation_id, nics.device_id, nics.update_time, nics.default_nic, nics.ip6_gateway, nics.ip6_cidr, nics.strategy, nics.vm_type, nics.created, nics.uuid, nics.secondary_ip) VALUES (29, null, null, null, null, null, null, null, null, 'Dhcp', 204, 'Allocated', _binary'DirectPodBasedNetworkGuru', null, 2, null, 1, null, null, 'Start', 'SecondaryStorageVm', '2014-08-24 19:04:13', _binary'7bae40cf-c5db-49c2-8b29-b528727f8057', 0) com.cloud.utils.exception.CloudRuntimeException: DB Exception on: com.mysql.jdbc.JDBC4PreparedStatement@6d760c36: INSERT INTO nics (nics.instance_id, nics.ip4_address, nics.ip6_address, nics.netmask, nics.isolation_uri, nics.ip_type, nics.broadcast_uri, nics.gateway, nics.mac_address, nics.mode, nics.network_id, nics.state, nics.reserver_name, nics.reservation_id, nics.device_id, nics.update_time, nics.default_nic, nics.ip6_gateway, nics.ip6_cidr, nics.strategy, nics.vm_type, nics.created, nics.uuid, nics.secondary_ip) VALUES (29, null, null, null, null, null, null, null, null, 'Dhcp', 204, 'Allocated', _binary'DirectPodBasedNetworkGuru', null, 2, null, 1, null, null, 'Start', 'SecondaryStorageVm', '2014-08-24 19:04:13', _binary'7bae40cf-c5db-49c2-8b29-b528727f8057', 0) at com.cloud.utils.db.GenericDaoBase.persist(GenericDaoBase.java:1400) at sun.reflect.GeneratedMethodAccessor40.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150) at com.cloud.utils.db.TransactionContextInterceptor.invoke(TransactionContextInterceptor.java:34) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204) at com.sun.proxy.$Proxy54.persist(Unknown Source) at org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.allocateNic(NetworkOrchestrator.java:821) at org.apache.cloudstack.engine.orchestration.NetworkOrchestrator$3.doInTransactionWithoutResult(NetworkOrchestrator.java:748) .............. 2014-08-24 15:04:45,697 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-110:ctx-5ed6ad5a job-2/job-119 ctx-1b6ba685 FirstFitRoutingAllocator) Found a suitable host, adding to list: 1 2014-08-24 15:04:45,697 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-110:ctx-5ed6ad5a job-2/job-119 ctx-1b6ba685 FirstFitRoutingAllocator) Host Allocator returning 1 suitable hosts 2014-08-24 15:04:46,173 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-110:ctx-5ed6ad5a job-2/job-119 ctx-1b6ba685) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: null 2014-08-24 15:04:46,270 ERROR [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-110:ctx-5ed6ad5a job-2/job-119 ctx-1b6ba685) Invocation exception, caused by: com.cloud.utils.exception.CloudRuntimeException: Unable to create deployment, no usable volumes found for the VM 2014-08-24 15:04:46,271 INFO [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-110:ctx-5ed6ad5a job-2/job-119 ctx-1b6ba685) Rethrow exception com.cloud.utils.exception.CloudRuntimeException: Unable to create deployment, no usable volumes found for the VM 2014-08-24 15:04:46,271 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-110:ctx-5ed6ad5a job-2/job-119) Done with run of VM work job: com.cloud.vm.VmWorkStart for VM 29, job origin: 2 2014-08-24 15:04:46,271 ERROR [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-110:ctx-5ed6ad5a job-2/job-119) Unable to complete AsyncJobVO {id:119, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAAAAHXQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 161331704522, completeMsid: null, lastUpdated: null, lastPolled: null, created: Sun Aug 24 15:04:40 EDT 2014}, job origin:2 com.cloud.utils.exception.CloudRuntimeException: Unable to create deployment, no usable volumes found for the VM at com.cloud.deploy.DeploymentPlanningManagerImpl.findSuitablePoolsForVolumes(DeploymentPlanningManagerImpl.java:1179) at com.cloud.deploy.DeploymentPlanningManagerImpl.checkClustersforDestination(DeploymentPlanningManagerImpl.java:941) at com.cloud.deploy.DeploymentPlanningManagerImpl.planDeployment(DeploymentPlanningManagerImpl.java:481) at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:931) at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:5190) at sun.reflect.GeneratedMethodAccessor178.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107) at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:5335) at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102) at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:503) at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53) at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46) at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:460) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)? I really can't see anything that I'm doing wrong. Everything seems to be set up perfectly and yet the system vm's cannot be created. Can someone please provide some insight into what I need to change??
