Hi , I have installed Cloud stack version 4.6 to be more precise - {"listcapabilitiesresponse":{"capability":{"securitygroupsenabled":false,"cloudstackversion":"4.6.2","userpublictemplateenabled":true,"supportELB":"false","projectinviterequired":false,"allowusercreateprojects":true,"customdiskofferingminsize":1,"customdiskofferingmaxsize":1024,"regionsecondaryenabled":false,"kvmsnapshotenabled":false,"allowuserviewdestroyedvm":true,"allowuserexpungerecovervm":true}}}
On Ubuntu 15.04 with following KVM details - Compiled against library: libvirt 1.2.12 Using library: libvirt 1.2.12 Using API: QEMU 1.2.12 Running hypervisor: QEMU 2.2.0 It's a single VM installation where storage and management server are on same VM . I have followed all the required steps from the documentation provided in - http://www.shapeblue.com/deploying-cloudstack-with-kvm/ I am able to successfully login management console and create ZONE , POD , CLUSTER successfully. Its failing while adding the host . Here are the log details (Log level changed to TRACE). Cloud stack- Agent dies after we try to add host from the console. It says active (exited) Management Logs : 2016-02-01 11:14:15,761 TRACE [c.c.u.d.T.Connection] (AgentConnectTaskPool-1:ctx-370d8502) Creating a DB connection with txn: for 0: dbconn78420063. Stack: -TransactionLegacy.prepareAutoCloseStatement:477-GenericDaoBase.persist:1368-HostDaoImpl.persist:797-HostDaoImpl.persist:69-NativeMethodAccessorImpl.invoke0:-2-NativeMethodAccessorImpl.invoke:57-DelegatingMethodAccessorImpl.invoke:43-Method.invoke:606-AopUtils.invokeJoinpointUsingReflection:317-ReflectiveMethodInvocation.invokeJoinpoint:183-ReflectiveMethodInvocation.proceed:150-TransactionContextInterceptor.invoke:34 2016-02-01 11:14:15,769 TRACE [c.c.u.d.T.Statement] (AgentConnectTaskPool-1:ctx-370d8502) Preparing: INSERT INTO host (host.disconnected, host.name, host.status, host.type, host.private_ip_address, host.private_mac_address, host.private_netmask, host.public_netmask, host.public_ip_address, host.public_mac_address, host.storage_ip_address, host.cluster_id, host.storage_netmask, host.storage_mac_address, host.storage_ip_address_2, host.storage_netmask_2, host.storage_mac_address_2, host.hypervisor_type, host.proxy_port, host.resource, host.fs_type, host.available, host.setup, host.resource_state, host.hypervisor_version, host.update_count, host.uuid, host.data_center_id, host.pod_id, host.cpu_sockets, host.cpus, host.url, host.speed, host.ram, host.parent, host.guid, host.capabilities, host.total_size, host.last_ping, host.mgmt_server_id, host.dom0_memory, host.version, host.created) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?) 2016-02-01 11:14:15,837 TRACE [c.c.u.d.T.Statement] (AgentConnectTaskPool-1:ctx-370d8502) Closing: com.mysql.jdbc.JDBC4PreparedStatement@5f47875e: INSERT INTO host (host.disconnected, host.name, host.status, host.type, host.private_ip_address, host.private_mac_address, host.private_netmask, host.public_netmask, host.public_ip_address, host.public_mac_address, host.storage_ip_address, host.cluster_id, host.storage_netmask, host.storage_mac_address, host.storage_ip_address_2, host.storage_netmask_2, host.storage_mac_address_2, host.hypervisor_type, host.proxy_port, host.resource, host.fs_type, host.available, host.setup, host.resource_state, host.hypervisor_version, host.update_count, host.uuid, host.data_center_id, host.pod_id, host.cpu_sockets, host.cpus, host.url, host.speed, host.ram, host.parent, host.guid, host.capabilities, host.total_size, host.last_ping, host.mgmt_server_id, host.dom0_memory, host.version, host.created) VALUES (null, _binary'cstest-virtual-machine', 'Creating', 'Routing', _binary'10.25.1.89', _binary'00:50:56:b3:1f:88', _binary'255.255.252.0', _binary'255.255.252.0', _binary'10.25.1.89', _binary'00:50:56:b3:1f:88', _binary'10.25.1.89', 2, _binary'255.255.252.0', _binary'00:50:56:b3:1f:88', null, null, null, 'KVM', null, null, null, 1, 0, 'Creating', null, 0, _binary'ffc9fd4c-4778-427d-95ba-e17293bb145e', 2, 2, 1, 1, null, 2393, -32403456, null, _binary'6f373eb2-fb89-31bf-85d7-ace20f4e5471-LibvirtComputingResource', _binary'hvm,snapshot', null, 1420267632, 20696084691758, 0, _binary'4.6.2', '2016-02-01 19:14:15') 2016-02-01 11:14:15,837 TRACE [c.c.u.d.T.Connection] (AgentConnectTaskPool-1:ctx-370d8502) txn: Not closing DB connection because we're still in a transaction. 2016-02-01 11:14:15,837 DEBUG [c.c.u.d.T.Transaction] (AgentConnectTaskPool-1:ctx-370d8502) Rolling back the transaction: Time = 77 Name = AgentConnectTaskPool-1; called by -TransactionLegacy.rollback:879-TransactionLegacy.removeUpTo:822-TransactionLegacy.close:646-TransactionContextInterceptor.invoke:36-ReflectiveMethodInvocation.proceed:161-ExposeInvocationInterceptor.invoke:91-ReflectiveMethodInvocation.proceed:172-JdkDynamicAopProxy.invoke:204-$Proxy59.persist:-1-ResourceManagerImpl.createHostVO:1701-ResourceManagerImpl.createHostVOForConnectedAgent:1952-NativeMethodAccessorImpl.invoke0:-2 2016-02-01 11:14:15,838 TRACE [c.c.u.d.T.Connection] (AgentConnectTaskPool-1:ctx-370d8502) Closing DB connection: dbconn78420063 2016-02-01 11:14:15,839 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-1:ctx-370d8502) Failed to handle host connection: com.cloud.utils.exception.CloudRuntimeException: DB Exception on: com.mysql.jdbc.JDBC4PreparedStatement@5f47875e: INSERT INTO host (host.disconnected, host.name, host.status, host.type, host.private_ip_address, host.private_mac_address, host.private_netmask, host.public_netmask, host.public_ip_address, host.public_mac_address, host.storage_ip_address, host.cluster_id, host.storage_netmask, host.storage_mac_address, host.storage_ip_address_2, host.storage_netmask_2, host.storage_mac_address_2, host.hypervisor_type, host.proxy_port, host.resource, host.fs_type, host.available, host.setup, host.resource_state, host.hypervisor_version, host.update_count, host.uuid, host.data_center_id, host.pod_id, host.cpu_sockets, host.cpus, host.url, host.speed, host.ram, host.parent, host.guid, host.capabilities, host.total_size, host.last_ping, host.mgmt_server_id, host.dom0_memory, host.version, host.created) VALUES (null, _binary'cstest-virtual-machine', 'Creating', 'Routing', _binary'10.25.1.89', _binary'00:50:56:b3:1f:88', _binary'255.255.252.0', _binary'255.255.252.0', _binary'10.25.1.89', _binary'00:50:56:b3:1f:88', _binary'10.25.1.89', 2, _binary'255.255.252.0', _binary'00:50:56:b3:1f:88', null, null, null, 'KVM', null, null, null, 1, 0, 'Creating', null, 0, _binary'ffc9fd4c-4778-427d-95ba-e17293bb145e', 2, 2, 1, 1, null, 2393, -32403456, null, _binary'6f373eb2-fb89-31bf-85d7-ace20f4e5471-LibvirtComputingResource', _binary'hvm,snapshot', null, 1420267632, 20696084691758, 0, _binary'4.6.2', '2016-02-01 19:14:15') 2016-02-01 11:14:15,850 TRACE [c.c.u.n.Link] (AgentConnectTaskPool-1:ctx-370d8502) Sending packet of length 1837 Agent Logs : 2016-02-01 11:14:14,930 INFO [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) Trying to fetch storage pool 654eecc6-a2fd-468f-a725-6d41e9a6b875 from libvirt 2016-02-01 11:14:14,930 DEBUG [kvm.resource.LibvirtConnection] (Agent-Handler-1:null) Looking for libvirtd connection at: qemu:///system 2016-02-01 11:14:14,955 DEBUG [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) Succesfully refreshed pool 654eecc6-a2fd-468f-a725-6d41e9a6b875 Capacity: 210186788864 Used: 5995126784 Available: 204191662080 2016-02-01 11:14:14,959 DEBUG [cloud.agent.Agent] (Agent-Handler-1:null) Executing: hostname 2016-02-01 11:14:14,961 DEBUG [cloud.agent.Agent] (Agent-Handler-1:null) Execution is successful. 2016-02-01 11:14:14,961 DEBUG [cloud.agent.Agent] (Agent-Handler-1:null) Executing: hostname 2016-02-01 11:14:14,962 DEBUG [cloud.agent.Agent] (Agent-Handler-1:null) Execution is successful. 2016-02-01 11:14:15,116 INFO [cloud.serializer.GsonHelper] (Agent-Handler-1:null) Default Builder inited. 2016-02-01 11:14:15,203 DEBUG [cloud.agent.Agent] (Agent-Handler-1:null) Sending Startup: Seq 0-0: { Cmd , MgmtId: -1, via: 0, Ver: v1, Flags: 1, [{"com.cloud.agent.api.StartupRoutingCommand":{"cpuSockets":1,"cpus":1,"speed":2393,"memory":-32403456,"dom0MinMemory":1073741824,"poolSync":false,"caps":"hvm,snapshot","pool":"/root","hypervisorType":"KVM","hostDetails":{"com.cloud.network.Networks.RouterPrivateIpStrategy":"HostLocal","Host.OS":"Ubuntu","Host.OS.Kernel.Version":"3.19.0-15-generic","Host.OS.Version":"15.04"},"hostTags":[],"groupDetails":{},"type":"Routing","dataCenter":"2","pod":"2","cluster":"2","guid":"6f373eb2-fb89-31bf-85d7-ace20f4e5471-LibvirtComputingResource","name":"cstest-virtual-machine","id":0,"version":"4.6.2","publicIpAddress":"10.25.1.89","publicNetmask":"255.255.252.0","publicMacAddress":"00:50:56:b3:1f:88","privateIpAddress":"10.25.1.89","privateMacAddress":"00:50:56:b3:1f:88","privateNetmask":"255.255.252.0","storageIpAddress":"10.25.1.89","storageNetmask":"255.255.252.0","storageMacAddress":"00:50:56:b3:1f:88","resourceName":"LibvirtComputingResource","gatewayIpAddress":"10.25.0.1","wait":0}},{"com.cloud.agent.api.StartupStorageCommand":{"totalSize":0,"poolInfo":{"uuid":"654eecc6-a2fd-468f-a725-6d41e9a6b875","host":"10.25.1.89","localPath":"/var/lib/libvirt/images","hostPath":"/var/lib/libvirt/images","poolType":"Filesystem","capacityBytes":210186788864,"availableBytes":204191662080},"resourceType":"STORAGE_POOL","hostDetails":{},"type":"Storage","dataCenter":"2","pod":"2","guid":"6f373eb2-fb89-31bf-85d7-ace20f4e5471-LibvirtComputingResource","name":"cstest-virtual-machine","id":0,"version":"4.6.2","resourceName":"LibvirtComputingResource","wait":0}}] } 2016-02-01 11:14:15,203 DEBUG [cloud.agent.Agent] (Agent-Handler-1:null) Startup task created 2016-02-01 11:14:15,396 DEBUG [cloud.agent.Agent] (Agent-Handler-2:null) Received response: Seq 0-0: { Ans: , MgmtId: 20696084691758, via: -1, Ver: v1, Flags: 100000, [{"com.cloud.agent.api.StartupAnswer":{"hostId":0,"pingInterval":60,"result":true,"wait":0}}] } 2016-02-01 11:14:15,397 DEBUG [cloud.agent.Agent] (Agent-Handler-2:null) Startup task cancelled 2016-02-01 11:14:15,397 INFO [cloud.agent.Agent] (Agent-Handler-2:null) Proccess agent startup answer, agent id = 0 2016-02-01 11:14:15,397 INFO [cloud.agent.Agent] (Agent-Handler-2:null) Set agent id 0 2016-02-01 11:14:15,422 DEBUG [cloud.agent.Agent] (Agent-Handler-2:null) Adding a watch list 2016-02-01 11:14:15,423 INFO [cloud.agent.Agent] (Agent-Handler-2:null) Startup Response Received: agent id = 0 2016-02-01 11:14:15,423 DEBUG [kvm.resource.LibvirtComputingResource] (UgentTask-1:null) Executing: /usr/share/cloudstack-common/scripts/vm/network/security_group.py get_rule_logs_for_vms 2016-02-01 11:14:16,024 DEBUG [cloud.agent.Agent] (agentRequest-Handler-1:null) Request:Seq -1--1: { Cmd , MgmtId: -1, via: -1, Ver: v1, Flags: 111, [{"com.cloud.agent.api.ReadyCommand":{"_details":"com.cloud.utils.exception.CloudRuntimeException: DB Exception on: com.mysql.jdbc.JDBC4PreparedStatement@5f47875e: INSERT INTO host (host.disconnected, host.name, host.status, host.type, host.private_ip_address, host.private_mac_address, host.private_netmask, host.public_netmask, host.public_ip_address, host.public_mac_address, host.storage_ip_address, host.cluster_id, host.storage_netmask, host.storage_mac_address, host.storage_ip_address_2, host.storage_netmask_2, host.storage_mac_address_2, host.hypervisor_type, host.proxy_port, host.resource, host.fs_type, host.available, host.setup, host.resource_state, host.hypervisor_version, host.update_count, host.uuid, host.data_center_id, host.pod_id, host.cpu_sockets, host.cpus, host.url, host.speed, host.ram, host.parent, host.guid, host.capabilities, host.total_size, host.last_ping, host.mgmt_server_id, host.dom0_memory, host.version, host.created) VALUES (null, _binary'cstest-virtual-machine', 'Creating', 'Routing', _binary'10.25.1.89', _binary'00:50:56:b3:1f:88', _binary'255.255.252.0', _binary'255.255.252.0', _binary'10.25.1.89', _binary'00:50:56:b3:1f:88', _binary'10.25.1.89', 2, _binary'255.255.252.0', _binary'00:50:56:b3:1f:88', null, null, null, 'KVM', null, null, null, 1, 0, 'Creating', null, 0, _binary'ffc9fd4c-4778-427d-95ba-e17293bb145e', 2, 2, 1, 1, null, 2393, -32403456, null, _binary'6f373eb2-fb89-31bf-85d7-ace20f4e5471-LibvirtComputingResource', _binary'hvm,snapshot', null, 1420267632, 20696084691758, 0, _binary'4.6.2', '2016-02-01 19:14:15')","wait":0}}] } 2016-02-01 11:14:16,028 DEBUG [cloud.agent.Agent] (agentRequest-Handler-1:null) Processing command: com.cloud.agent.api.ReadyCommand 2016-02-01 11:14:16,028 DEBUG [cloud.agent.Agent] (agentRequest-Handler-1:null) Not ready to connect to mgt server: com.cloud.utils.exception.CloudRuntimeException: DB Exception on: com.mysql.jdbc.JDBC4PreparedStatement@5f47875e: INSERT INTO host (host.disconnected, host.name, host.status, host.type, host.private_ip_address, host.private_mac_address, host.private_netmask, host.public_netmask, host.public_ip_address, host.public_mac_address, host.storage_ip_address, host.cluster_id, host.storage_netmask, host.storage_mac_address, host.storage_ip_address_2, host.storage_netmask_2, host.storage_mac_address_2, host.hypervisor_type, host.proxy_port, host.resource, host.fs_type, host.available, host.setup, host.resource_state, host.hypervisor_version, host.update_count, host.uuid, host.data_center_id, host.pod_id, host.cpu_sockets, host.cpus, host.url, host.speed, host.ram, host.parent, host.guid, host.capabilities, host.total_size, host.last_ping, host.mgmt_server_id, host.dom0_memory, host.version, host.created) VALUES (null, _binary'cstest-virtual-machine', 'Creating', 'Routing', _binary'10.25.1.89', _binary'00:50:56:b3:1f:88', _binary'255.255.252.0', _binary'255.255.252.0', _binary'10.25.1.89', _binary'00:50:56:b3:1f:88', _binary'10.25.1.89', 2, _binary'255.255.252.0', _binary'00:50:56:b3:1f:88', null, null, null, 'KVM', null, null, null, 1, 0, 'Creating', null, 0, _binary'ffc9fd4c-4778-427d-95ba-e17293bb145e', 2, 2, 1, 1, null, 2393, -32403456, null, _binary'6f373eb2-fb89-31bf-85d7-ace20f4e5471-LibvirtComputingResource', _binary'hvm,snapshot', null, 1420267632, 20696084691758, 0, _binary'4.6.2', '2016-02-01 19:14:15') 2016-02-01 11:14:16,030 DEBUG [kvm.resource.LibvirtComputingResource] (UgentTask-1:null) Execution is successful. 2016-02-01 11:14:16,036 DEBUG [kvm.resource.LibvirtConnection] (UgentTask-1:null) Looking for libvirtd connection at: qemu:///system 2016-02-01 11:14:16,039 DEBUG [cloud.agent.Agent] (UgentTask-1:null) Sending ping: Seq 0-1: { Cmd , MgmtId: -1, via: 0, Ver: v1, Flags: 11, [{"com.cloud.agent.api.PingRoutingWithNwGroupsCommand":{"newGroupStates":{},"_hostVmStateReport":{},"_gatewayAccessible":true,"_vnetAccessible":true,"hostType":"Routing","hostId":0,"wait":0}}] } 2016-02-01 11:14:16,042 INFO [cloud.agent.Agent] (AgentShutdownThread:null) Stopping the agent: Reason = sig.kill 2016-02-01 11:14:16,043 DEBUG [cloud.agent.Agent] (AgentShutdownThread:null) Sending shutdown to management server Any pointers or help would be much appreciated. Thanks, Keyur Bhalerao DISCLAIMER ========== This e-mail may contain privileged and confidential information which is the property of Persistent Systems Ltd. It is intended only for the use of the individual or entity to which it is addressed. If you are not the intended recipient, you are not authorized to read, retain, copy, print, distribute or use this message. If you have received this communication in error, please notify the sender and delete all copies of this message. Persistent Systems Ltd. does not accept any liability for virus infected mails.