Hello,
I just finished rebuilding the management server and node and I'm getting the same error. I now have full setup and agent/management server logs if you need the for further investigation. What other things might you need to resolve this issue? On Thu, Mar 1, 2018 at 10:46 AM, Daznis <daz...@gmail.com> wrote: > Hello, > > That's when I shutdown the agent and started from scratch . > > On Wed, Feb 28, 2018 at 11:08 PM, Rohit Yadav <rohit.ya...@shapeblue.com> > wrote: >> Hi Daznis, >> >> >> I see the agent decided to kill itself: >> >> 2018-02-28 03:56:34,183 INFO [cloud.agent.Agent] (AgentShutdownThread:null) >> (logid:) Stopping the agent: Reason = sig.kill >> >> >> This happens when the management server send a ShutDown command to the >> agent. Without logs and additional debugging it will be hard to tell, but >> something went wrong on the management server side. It's possible that the >> mgmt server decided to kill the agent for failure to add the host. >> >> >> You may re-attempt host addition or you can attempt a fresh installation and >> share the details if it fails again. >> >> >> - Rohit >> >> <https://cloudstack.apache.org> >> >> >> >> ________________________________ >> From: Daznis <daz...@gmail.com> >> Sent: Wednesday, February 28, 2018 7:13:54 PM >> To: users@cloudstack.apache.org >> Subject: Re: Cloudstack 4.11 fails to add KVM host >> >> Hello, >> >> >> Unfortunately I didn't have full debug on. So I can't provide you with >> more detailed logs. I currently wiped both the management and node >> servers and started over. If I will encounter the same issue I will >> provide more detailed logs. >> >> >> Repo: >> >> [cloudstack] >> name=cloudstack >> baseurl=http://cloudstack.apt-get.eu/centos/$releasever/4.11/ >> enabled=1 >> gpgcheck=0 >> >> >> Agent and management log parts attached. >> >> >> >> >> >> >> rohit.ya...@shapeblue.com >> www.shapeblue.com >> 53 Chandos Place, Covent Garden, London WC2N 4HSUK >> @shapeblue >> >> >> >> On Wed, Feb 28, 2018 at 1:36 PM, Rohit Yadav <rohit.ya...@shapeblue.com> >> wrote: >>> Hi Daznis, >>> >>> >>> Can you share full logs when you're trying to add the KVM host. In the >>> logs, do you see something like: >>> >>> SSH command: lsmod|grep kvm >>> Or, >>> Executing cmd: cloudstack-setup-agent -m 172.20.0.1 -z 1 -p 1 -c 1 -g >>> 72f644c9-4f58-3048-8e32-901d38d30672 -a --pubNic=cloudbr0 --prvNic=cloudbr0 >>> --guestNic=cloudbr0 --hypervisor=kvm >>> >>> I don't see any logs related to c.c.h.k.d.LibvirtServerDiscoverer. Which >>> repository did you use to install ACS 4.11? >>> >>> >>> Also, can you share the agent logs (in your KVM host's, from >>> /var/log/cloudstack/agent/)? >>> >>> >>> - Rohit >>> >>> <https://cloudstack.apache.org> >>> >>> >>> >>> ________________________________ >>> From: Daznis <daz...@gmail.com> >>> Sent: Wednesday, February 28, 2018 10:42:17 AM >>> To: users@cloudstack.apache.org >>> Subject: Cloudstack 4.11 fails to add KVM host >>> >>> Hello, >>> >>> I'm trying to setup a test VPC cloudstack installation and encountered >>> an error while adding hosts to the cluster. The host sort of appears >>> to be added, but it's not functioning. Trying to add the same host I >>> get an error that host is already present. Both management server and >>> host are running centos 7.4 with latest updates and cloudstack 4.11. >>> >>> >>> >>> >>> >>> management-server.log: >>> >>> 2018-02-28 03:01:47,516 DEBUG [c.c.r.ResourceState] >>> (AgentConnectTaskPool-1:ctx-e30615f2) (logid:541691a9) Resource state >>> update: [id = 1; name = chi-phv01; old state = Creating; event = >>> InternalCreated; new state = Enabled] >>> 2018-02-28 03:01:47,516 DEBUG [c.c.h.Status] >>> (AgentConnectTaskPool-1:ctx-e30615f2) (logid:541691a9) >>> Transition:[Resource state = Enabled, Agent event = AgentConnected, >>> Host id = 1, name = chi-phv01] >>> 2018-02-28 03:01:47,529 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] >>> (AgentConnectTaskPool-1:ctx-e30615f2) (logid:541691a9) create >>> ClusteredAgentAttache for 1 >>> 2018-02-28 03:01:47,530 DEBUG [c.c.a.m.AgentManagerImpl] >>> (AgentConnectTaskPool-1:ctx-e30615f2) (logid:541691a9) Sending Connect >>> to listener: XcpServerDiscoverer >>> 2018-02-28 03:01:47,530 DEBUG [c.c.h.x.d.XcpServerDiscoverer] >>> (AgentConnectTaskPool-1:ctx-e30615f2) (logid:541691a9) Not XenServer >>> so moving on. >>> 2018-02-28 03:01:47,530 DEBUG [c.c.a.m.AgentManagerImpl] >>> (AgentConnectTaskPool-1:ctx-e30615f2) (logid:541691a9) Sending Connect >>> to listener: HypervServerDiscoverer >>> 2018-02-28 03:01:47,530 DEBUG [c.c.h.h.d.HypervServerDiscoverer] >>> (AgentConnectTaskPool-1:ctx-e30615f2) (logid:541691a9) Not Hyper-V >>> hypervisor, so moving on. >>> 2018-02-28 03:01:47,530 DEBUG [c.c.a.m.AgentManagerImpl] >>> (AgentConnectTaskPool-1:ctx-e30615f2) (logid:541691a9) Sending Connect >>> to listener: SecondaryStorageListener >>> 2018-02-28 03:01:47,530 DEBUG [c.c.a.m.AgentManagerImpl] >>> (AgentConnectTaskPool-1:ctx-e30615f2) (logid:541691a9) Sending Connect >>> to listener: StoragePoolMonitor >>> 2018-02-28 03:01:47,537 DEBUG [c.c.a.m.AgentManagerImpl] >>> (AgentConnectTaskPool-1:ctx-e30615f2) (logid:541691a9) Sending Connect >>> to listener: NetworkOrchestrator >>> 2018-02-28 03:01:47,538 DEBUG [o.a.c.e.o.NetworkOrchestrator] >>> (AgentConnectTaskPool-1:ctx-e30615f2) (logid:541691a9) Host's >>> hypervisorType is: KVM >>> 2018-02-28 03:01:47,544 DEBUG [o.a.c.e.o.NetworkOrchestrator] >>> (AgentConnectTaskPool-1:ctx-e30615f2) (logid:541691a9) Sending >>> CheckNetworkCommand to check the Network is setup correctly on Agent >>> 2018-02-28 03:01:47,553 DEBUG [c.c.a.t.Request] >>> (AgentConnectTaskPool-1:ctx-e30615f2) (logid:541691a9) Seq >>> 1-6113355019178737665: Sending { Cmd , MgmtId: 2200401215515, via: >>> 1(chi-phv01), Ver: v1, Flags: 100111, >>> [{"com.cloud.agent.api.CheckNetworkCommand":{"networkInfoList":[{"physicalNetworkId":200,"privateNetworkName":"bond0.57","publicNetworkName":"bridge-bond0","guestNetworkName":"bridge-bond0"}],"wait":0}}] >>> } >>> 2018-02-28 03:01:47,627 DEBUG [c.c.a.m.AgentManagerImpl] >>> (AgentManager-Handler-3:null) (logid:) Ping from 1(chi-phv01) >>> 2018-02-28 03:01:47,628 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] >>> (AgentManager-Handler-3:null) (logid:) Process host VM state report >>> from ping process. host: 1 >>> 2018-02-28 03:01:47,628 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] >>> (AgentManager-Handler-3:null) (logid:) Process VM state report. host: >>> 1, number of records in report: 0 >>> 2018-02-28 03:01:47,630 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] >>> (AgentManager-Handler-3:null) (logid:) Done with process of VM state >>> report. host: 1 >>> 2018-02-28 03:01:47,632 INFO [c.c.a.m.AgentManagerImpl] >>> (AgentManager-Handler-3:null) (logid:) PingMap for agent: 1 will not >>> be updated because agent is no longer in the PingMap >>> 2018-02-28 03:01:47,633 DEBUG [c.c.a.m.AgentManagerImpl] >>> (AgentManager-Handler-3:null) (logid:) Not processing >>> PingRoutingCommand for agent id=0; can't find the host in the DB >>> 2018-02-28 03:01:47,738 DEBUG [c.c.a.t.Request] >>> (AgentManager-Handler-4:null) (logid:) Seq 1-6113355019178737665: >>> Processing: { Ans: , MgmtId: 2200401215515, via: 1, Ver: v1, Flags: >>> 110, >>> [{"com.cloud.agent.api.CheckNetworkAnswer":{"_reconnect":false,"result":true,"wait":0}}] >>> } >>> 2018-02-28 03:01:47,739 DEBUG [c.c.a.m.AgentAttache] >>> (AgentManager-Handler-4:null) (logid:) Seq 1-6113355019178737665: No >>> more commands found >>> 2018-02-28 03:01:47,740 DEBUG [c.c.a.t.Request] >>> (AgentConnectTaskPool-1:ctx-e30615f2) (logid:541691a9) Seq >>> 1-6113355019178737665: Received: { Ans: , MgmtId: 2200401215515, via: >>> 1(chi-phv01), Ver: v1, Flags: 110, { CheckNetworkAnswer } } >>> 2018-02-28 03:01:47,740 DEBUG [o.a.c.e.o.NetworkOrchestrator] >>> (AgentConnectTaskPool-1:ctx-e30615f2) (logid:541691a9) Network setup >>> is correct on Agent >>> 2018-02-28 03:01:47,740 DEBUG [c.c.a.m.AgentManagerImpl] >>> (AgentConnectTaskPool-1:ctx-e30615f2) (logid:541691a9) Sending Connect >>> to listener: SecurityGroupListener >>> 2018-02-28 03:01:47,740 INFO [c.c.n.s.SecurityGroupListener] >>> (AgentConnectTaskPool-1:ctx-e30615f2) (logid:541691a9) Received a host >>> startup notification >>> 2018-02-28 03:01:47,742 DEBUG [c.c.a.t.Request] >>> (AgentConnectTaskPool-1:ctx-e30615f2) (logid:541691a9) Seq >>> 1-6113355019178737666: Sending { Cmd , MgmtId: 2200401215515, via: >>> 1(chi-phv01), Ver: v1, Flags: 100011, >>> [{"com.cloud.agent.api.CleanupNetworkRulesCmd":{"interval":2239,"wait":0}}] >>> } >>> 2018-02-28 03:01:47,743 INFO [c.c.n.s.SecurityGroupListener] >>> (AgentConnectTaskPool-1:ctx-e30615f2) (logid:541691a9) Scheduled >>> network rules cleanup, interval=2239 >>> 2018-02-28 03:01:47,743 INFO [c.c.n.s.SecurityGroupListener] >>> (AgentConnectTaskPool-1:ctx-e30615f2) (logid:541691a9) Received a host >>> startup notification >>> 2018-02-28 03:01:47,743 DEBUG [c.c.a.m.AgentManagerImpl] >>> (AgentConnectTaskPool-1:ctx-e30615f2) (logid:541691a9) Sending Connect >>> to listener: ClusteredVirtualMachineManagerImpl >>> 2018-02-28 03:01:47,743 DEBUG [c.c.v.VirtualMachineManagerImpl] >>> (AgentConnectTaskPool-1:ctx-e30615f2) (logid:541691a9) Received >>> startup command from hypervisor host. host id: 1 >>> 2018-02-28 03:01:47,743 INFO [c.c.v.VirtualMachinePowerStateSyncImpl] >>> (AgentConnectTaskPool-1:ctx-e30615f2) (logid:541691a9) Reset VM power >>> state sync for host: 1 >>> 2018-02-28 03:01:47,755 DEBUG [c.c.a.m.AgentManagerImpl] >>> (AgentConnectTaskPool-1:ctx-e30615f2) (logid:541691a9) Sending Connect >>> to listener: DeploymentPlanningManagerImpl >>> 2018-02-28 03:01:47,763 DEBUG [c.c.a.m.AgentManagerImpl] >>> (AgentConnectTaskPool-1:ctx-e30615f2) (logid:541691a9) Sending Connect >>> to listener: SshKeysDistriMonitor >>> 2018-02-28 03:01:47,769 DEBUG [c.c.a.t.Request] >>> (AgentConnectTaskPool-1:ctx-e30615f2) (logid:541691a9) Seq >>> 1-6113355019178737667: Sending { Cmd , MgmtId: 2200401215515, via: >>> 1(chi-phv01), Ver: v1, Flags: 100011, >>> [{"com.cloud.agent.api.ModifySshKeysCommand":{"wait":0}}] } >>> 2018-02-28 03:01:47,769 DEBUG [c.c.a.m.AgentManagerImpl] >>> (AgentConnectTaskPool-1:ctx-e30615f2) (logid:541691a9) Sending Connect >>> to listener: VirtualNetworkApplianceManagerImpl >>> 2018-02-28 03:01:47,771 DEBUG [c.c.a.m.AgentManagerImpl] >>> (AgentConnectTaskPool-1:ctx-e30615f2) (logid:541691a9) Sending Connect >>> to listener: UploadListener >>> 2018-02-28 03:01:47,772 DEBUG [c.c.a.m.AgentManagerImpl] >>> (AgentConnectTaskPool-1:ctx-e30615f2) (logid:541691a9) Sending Connect >>> to listener: SshKeysDistriMonitor >>> 2018-02-28 03:01:47,776 DEBUG [c.c.a.t.Request] >>> (AgentConnectTaskPool-1:ctx-e30615f2) (logid:541691a9) Seq >>> 1-6113355019178737668: Sending { Cmd , MgmtId: 2200401215515, via: >>> 1(chi-phv01), Ver: v1, Flags: 100011, >>> [{"com.cloud.agent.api.ModifySshKeysCommand":{"wait":0}}] } >>> 2018-02-28 03:01:47,776 DEBUG [c.c.a.m.AgentManagerImpl] >>> (AgentConnectTaskPool-1:ctx-e30615f2) (logid:541691a9) Sending Connect >>> to listener: VpcVirtualNetworkApplianceManagerImpl >>> 2018-02-28 03:01:47,778 DEBUG [c.c.a.m.AgentManagerImpl] >>> (AgentConnectTaskPool-1:ctx-e30615f2) (logid:541691a9) Sending Connect >>> to listener: BehindOnPingListener >>> 2018-02-28 03:01:47,779 DEBUG [c.c.a.m.AgentManagerImpl] >>> (AgentConnectTaskPool-1:ctx-e30615f2) (logid:541691a9) Sending Connect >>> to listener: SetHostParamsListener >>> 2018-02-28 03:01:47,781 DEBUG [c.c.a.t.Request] >>> (AgentConnectTaskPool-1:ctx-e30615f2) (logid:541691a9) Seq >>> 1-6113355019178737669: Sending { Cmd , MgmtId: 2200401215515, via: >>> 1(chi-phv01), Ver: v1, Flags: 100111, >>> [{"com.cloud.agent.api.SetHostParamsCommand":{"params":{"router.aggregation.command.each.timeout":"600"},"wait":0}}] >>> } >>> 2018-02-28 03:01:47,781 DEBUG [c.c.a.m.AgentManagerImpl] >>> (AgentConnectTaskPool-1:ctx-e30615f2) (logid:541691a9) Sending Connect >>> to listener: DownloadListener >>> 2018-02-28 03:01:47,792 DEBUG [c.c.a.t.Request] >>> (AgentManager-Handler-5:null) (logid:) Seq 1-6113355019178737666: >>> Processing: { Ans: , MgmtId: 2200401215515, via: 1, Ver: v1, Flags: >>> 10, [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}}] } >>> 2018-02-28 03:01:47,793 DEBUG [c.c.a.t.Request] >>> (AgentManager-Handler-6:null) (logid:) Seq 1-6113355019178737667: >>> Processing: { Ans: , MgmtId: 2200401215515, via: 1, Ver: v1, Flags: >>> 10, [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}}] } >>> 2018-02-28 03:01:47,833 DEBUG [c.c.a.t.Request] >>> (AgentManager-Handler-7:null) (logid:) Seq 1-6113355019178737669: >>> Processing: { Ans: , MgmtId: 2200401215515, via: 1, Ver: v1, Flags: >>> 110, [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}}] } >>> 2018-02-28 03:01:47,833 DEBUG [c.c.a.m.AgentAttache] >>> (AgentManager-Handler-7:null) (logid:) Seq 1-6113355019178737669: No >>> more commands found >>> 2018-02-28 03:01:47,834 INFO [c.c.a.m.ClusteredAgentManagerImpl] >>> (AgentManager-Handler-7:null) (logid:) SeqA 1-6113355019178737669: >>> Response is not processed: Seq 1-6113355019178737669: { Ans: , >>> MgmtId: 2200401215515, via: 1, Ver: v1, Flags: 110, >>> [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}}] } >>> 2018-02-28 03:01:47,834 DEBUG [c.c.a.t.Request] >>> (AgentManager-Handler-8:null) (logid:) Seq 1-6113355019178737668: >>> Processing: { Ans: , MgmtId: 2200401215515, via: 1, Ver: v1, Flags: >>> 10, [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}}] } >>> 2018-02-28 03:01:47,874 DEBUG [c.c.a.m.AgentManagerImpl] >>> (AgentConnectTaskPool-1:ctx-e30615f2) (logid:541691a9) Sending Connect >>> to listener: StorageCapacityListener >>> 2018-02-28 03:01:47,874 DEBUG [c.c.a.m.AgentManagerImpl] >>> (AgentConnectTaskPool-1:ctx-e30615f2) (logid:541691a9) Sending Connect >>> to listener: ComputeCapacityListener >>> 2018-02-28 03:01:47,878 DEBUG [c.c.c.CapacityManagerImpl] >>> (AgentConnectTaskPool-1:ctx-e30615f2) (logid:541691a9) Found 0 VMs on >>> host 1 >>> 2018-02-28 03:01:47,882 DEBUG [c.c.c.CapacityManagerImpl] >>> (AgentConnectTaskPool-1:ctx-e30615f2) (logid:541691a9) Found 0 VM, not >>> running on host 1 >>> 2018-02-28 03:01:47,912 DEBUG [c.c.a.m.AgentManagerImpl] >>> (AgentConnectTaskPool-1:ctx-e30615f2) (logid:541691a9) Sending Connect >>> to listener: ConsoleProxyListener >>> 2018-02-28 03:01:47,912 DEBUG [c.c.a.m.AgentManagerImpl] >>> (AgentConnectTaskPool-1:ctx-e30615f2) (logid:541691a9) Sending Connect >>> to listener: LocalStoragePoolListener >>> 2018-02-28 03:01:47,914 DEBUG [c.c.a.m.AgentManagerImpl] >>> (AgentConnectTaskPool-1:ctx-e30615f2) (logid:541691a9) Sending Connect >>> to listener: DirectNetworkStatsListener >>> 2018-02-28 03:01:47,917 DEBUG [c.c.a.t.Request] >>> (AgentConnectTaskPool-1:ctx-e30615f2) (logid:541691a9) Seq >>> 1-6113355019178737670: Sending { Cmd , MgmtId: 2200401215515, via: >>> 1(chi-phv01), Ver: v1, Flags: 100111, >>> [{"com.cloud.agent.api.ReadyCommand":{"dcId":1,"hostId":1,"wait":0}}] >>> } >>> 2018-02-28 03:01:47,951 DEBUG [c.c.a.t.Request] >>> (AgentManager-Handler-9:null) (logid:) Seq 1-6113355019178737666: >>> Processing: { Ans: , MgmtId: 2200401215515, via: 1, Ver: v1, Flags: >>> 10, [{"com.cloud.agent.api.Answer":{"result":true,"details":"","wait":0}}] >>> } >>> 2018-02-28 03:01:47,991 DEBUG [c.c.a.t.Request] >>> (AgentManager-Handler-10:null) (logid:) Seq 1-6113355019178737670: >>> Processing: { Ans: , MgmtId: 2200401215515, via: 1, Ver: v1, Flags: >>> 110, [{"com.cloud.agent.api.ReadyAnswer":{"result":true,"wait":0}}] } >>> 2018-02-28 03:01:47,991 DEBUG [c.c.a.m.AgentAttache] >>> (AgentManager-Handler-10:null) (logid:) Seq 1-6113355019178737670: No >>> more commands found >>> 2018-02-28 03:01:47,992 DEBUG [c.c.a.t.Request] >>> (AgentConnectTaskPool-1:ctx-e30615f2) (logid:541691a9) Seq >>> 1-6113355019178737670: Received: { Ans: , MgmtId: 2200401215515, via: >>> 1(chi-phv01), Ver: v1, Flags: 110, { ReadyAnswer } } >>> 2018-02-28 03:01:47,992 DEBUG [c.c.h.Status] >>> (AgentConnectTaskPool-1:ctx-e30615f2) (logid:541691a9) >>> Transition:[Resource state = Enabled, Agent event = Ready, Host id = >>> 1, name = chi-phv01] >>> 2018-02-28 03:01:48,014 DEBUG [c.c.a.t.Request] >>> (AgentConnectTaskPool-1:ctx-e30615f2) (logid:541691a9) Seq >>> 1-6113355019178737671: Sending { Cmd , MgmtId: 2200401215515, via: >>> 1(chi-phv01), Ver: v1, Flags: 100111, >>> [{"com.cloud.agent.api.ReadyCommand":{"dcId":1,"hostId":1,"wait":0}}] >>> } >>> 2018-02-28 03:01:48,099 DEBUG [c.c.a.t.Request] >>> (AgentManager-Handler-11:null) (logid:) Seq 1-6113355019178737671: >>> Processing: { Ans: , MgmtId: 2200401215515, via: 1, Ver: v1, Flags: >>> 110, [{"com.cloud.agent.api.ReadyAnswer":{"result":true,"wait":0}}] } >>> 2018-02-28 03:01:48,099 DEBUG [c.c.a.m.AgentAttache] >>> (AgentManager-Handler-11:null) (logid:) Seq 1-6113355019178737671: No >>> more commands found >>> 2018-02-28 03:01:48,099 DEBUG [c.c.a.t.Request] >>> (AgentConnectTaskPool-1:ctx-e30615f2) (logid:541691a9) Seq >>> 1-6113355019178737671: Received: { Ans: , MgmtId: 2200401215515, via: >>> 1(chi-phv01), Ver: v1, Flags: 110, { ReadyAnswer } } >>> 2018-02-28 03:01:52,741 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] >>> (AsyncJobMgr-Heartbeat-1:ctx-50530b32) (logid:28780ab2) Begin cleanup >>> expired async-jobs >>> 2018-02-28 03:01:52,745 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] >>> (AsyncJobMgr-Heartbeat-1:ctx-50530b32) (logid:28780ab2) End cleanup >>> expired async-jobs >>> 2018-02-28 03:01:58,476 DEBUG [c.c.c.ConsoleProxyManagerImpl] >>> (consoleproxy-1:ctx-f0b6d74b) (logid:64b70007) Skip capacity scan as >>> there is no Primary Storage in 'Up' state >>> 2018-02-28 03:02:02,741 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] >>> (AsyncJobMgr-Heartbeat-1:ctx-03121b2c) (logid:8451c9ee) Begin cleanup >>> expired async-jobs >>> 2018-02-28 03:02:02,745 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] >>> (AsyncJobMgr-Heartbeat-1:ctx-03121b2c) (logid:8451c9ee) End cleanup >>> expired async-jobs >>> 2018-02-28 03:02:10,933 DEBUG [c.c.a.m.AgentManagerImpl] >>> (qtp788117692-15:ctx-8f3b4977 ctx-da6bfb2f) (logid:f8587145) Sending >>> host added to listener: XcpServerDiscoverer >>> 2018-02-28 03:02:10,933 DEBUG [c.c.a.m.AgentManagerImpl] >>> (qtp788117692-15:ctx-8f3b4977 ctx-da6bfb2f) (logid:f8587145) Sending >>> host added to listener: HypervServerDiscoverer >>> 2018-02-28 03:02:10,933 DEBUG [c.c.a.m.AgentManagerImpl] >>> (qtp788117692-15:ctx-8f3b4977 ctx-da6bfb2f) (logid:f8587145) Sending >>> host added to listener: SecondaryStorageListener >>> 2018-02-28 03:02:10,933 DEBUG [c.c.a.m.AgentManagerImpl] >>> (qtp788117692-15:ctx-8f3b4977 ctx-da6bfb2f) (logid:f8587145) Sending >>> host added to listener: StoragePoolMonitor >>> 2018-02-28 03:02:10,946 DEBUG [c.c.a.m.AgentManagerImpl] >>> (qtp788117692-15:ctx-8f3b4977 ctx-da6bfb2f) (logid:f8587145) Sending >>> host added to listener: NetworkOrchestrator >>> 2018-02-28 03:02:10,946 DEBUG [c.c.a.m.AgentManagerImpl] >>> (qtp788117692-15:ctx-8f3b4977 ctx-da6bfb2f) (logid:f8587145) Sending >>> host added to listener: SecurityGroupListener >>> 2018-02-28 03:02:10,946 DEBUG [c.c.a.m.AgentManagerImpl] >>> (qtp788117692-15:ctx-8f3b4977 ctx-da6bfb2f) (logid:f8587145) Sending >>> host added to listener: ClusteredVirtualMachineManagerImpl >>> 2018-02-28 03:02:10,946 DEBUG [c.c.a.m.AgentManagerImpl] >>> (qtp788117692-15:ctx-8f3b4977 ctx-da6bfb2f) (logid:f8587145) Sending >>> host added to listener: DeploymentPlanningManagerImpl >>> 2018-02-28 03:02:10,946 DEBUG [c.c.a.m.AgentManagerImpl] >>> (qtp788117692-15:ctx-8f3b4977 ctx-da6bfb2f) (logid:f8587145) Sending >>> host added to listener: SshKeysDistriMonitor >>> 2018-02-28 03:02:10,946 DEBUG [c.c.a.m.AgentManagerImpl] >>> (qtp788117692-15:ctx-8f3b4977 ctx-da6bfb2f) (logid:f8587145) Sending >>> host added to listener: VirtualNetworkApplianceManagerImpl >>> 2018-02-28 03:02:10,946 DEBUG [c.c.a.m.AgentManagerImpl] >>> (qtp788117692-15:ctx-8f3b4977 ctx-da6bfb2f) (logid:f8587145) Sending >>> host added to listener: UploadListener >>> 2018-02-28 03:02:10,946 DEBUG [c.c.a.m.AgentManagerImpl] >>> (qtp788117692-15:ctx-8f3b4977 ctx-da6bfb2f) (logid:f8587145) Sending >>> host added to listener: SshKeysDistriMonitor >>> 2018-02-28 03:02:10,946 DEBUG [c.c.a.m.AgentManagerImpl] >>> (qtp788117692-15:ctx-8f3b4977 ctx-da6bfb2f) (logid:f8587145) Sending >>> host added to listener: VpcVirtualNetworkApplianceManagerImpl >>> 2018-02-28 03:02:10,946 DEBUG [c.c.a.m.AgentManagerImpl] >>> (qtp788117692-15:ctx-8f3b4977 ctx-da6bfb2f) (logid:f8587145) Sending >>> host added to listener: BehindOnPingListener >>> 2018-02-28 03:02:10,946 DEBUG [c.c.a.m.AgentManagerImpl] >>> (qtp788117692-15:ctx-8f3b4977 ctx-da6bfb2f) (logid:f8587145) Sending >>> host added to listener: SetHostParamsListener >>> 2018-02-28 03:02:10,946 DEBUG [c.c.a.m.AgentManagerImpl] >>> (qtp788117692-15:ctx-8f3b4977 ctx-da6bfb2f) (logid:f8587145) Sending >>> host added to listener: DownloadListener >>> 2018-02-28 03:02:10,946 DEBUG [c.c.a.m.AgentManagerImpl] >>> (qtp788117692-15:ctx-8f3b4977 ctx-da6bfb2f) (logid:f8587145) Sending >>> host added to listener: StorageCapacityListener >>> 2018-02-28 03:02:10,946 DEBUG [c.c.a.m.AgentManagerImpl] >>> (qtp788117692-15:ctx-8f3b4977 ctx-da6bfb2f) (logid:f8587145) Sending >>> host added to listener: ComputeCapacityListener >>> 2018-02-28 03:02:10,946 DEBUG [c.c.a.m.AgentManagerImpl] >>> (qtp788117692-15:ctx-8f3b4977 ctx-da6bfb2f) (logid:f8587145) Sending >>> host added to listener: ConsoleProxyListener >>> 2018-02-28 03:02:10,946 DEBUG [c.c.a.m.AgentManagerImpl] >>> (qtp788117692-15:ctx-8f3b4977 ctx-da6bfb2f) (logid:f8587145) Sending >>> host added to listener: LocalStoragePoolListener >>> 2018-02-28 03:02:10,946 DEBUG [c.c.a.m.AgentManagerImpl] >>> (qtp788117692-15:ctx-8f3b4977 ctx-da6bfb2f) (logid:f8587145) Sending >>> host added to listener: DirectNetworkStatsListener >>> 2018-02-28 03:02:10,949 ERROR [c.c.a.ApiServer] >>> (qtp788117692-15:ctx-8f3b4977 ctx-da6bfb2f) (logid:f8587145) unhandled >>> exception executing api command: [Ljava.lang.String;@165f3bf2 >>> java.lang.IndexOutOfBoundsException: Index: 0, Size: 0 >>> at java.util.ArrayList.rangeCheck(ArrayList.java:657) >>> at java.util.ArrayList.get(ArrayList.java:433) >>> at >>> com.cloud.api.ApiResponseHelper.createHostResponse(ApiResponseHelper.java:654) >>> at >>> com.cloud.api.ApiResponseHelper.createHostResponse(ApiResponseHelper.java:646) >>> at >>> org.apache.cloudstack.api.command.admin.host.AddHostCmd.execute(AddHostCmd.java:147) >>> at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:150) >>> at com.cloud.api.ApiServer.queueCommand(ApiServer.java:731) >>> at com.cloud.api.ApiServer.handleRequest(ApiServer.java:555) >>> at >>> com.cloud.api.ApiServlet.processRequestInContext(ApiServlet.java:310) >>> at com.cloud.api.ApiServlet$1.run(ApiServlet.java:130) >>> at >>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56) >>> at >>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103) >>> at >>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53) >>> at com.cloud.api.ApiServlet.processRequest(ApiServlet.java:127) >>> at com.cloud.api.ApiServlet.doPost(ApiServlet.java:94) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:706) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:791) >>> at >>> org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:852) >>> at >>> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:535) >>> at >>> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) >>> at >>> org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) >>> at >>> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) >>> at >>> org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:190) >>> at >>> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595) >>> at >>> org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188) >>> at >>> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1253) >>> at >>> org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:168) >>> at >>> org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473) >>> at >>> org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564) >>> at >>> org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:166) >>> at >>> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1155) >>> at >>> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) >>> at >>> org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:527) >>> at >>> org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:126) >>> at >>> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) >>> at org.eclipse.jetty.server.Server.handle(Server.java:530) >>> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:347) >>> at >>> org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:256) >>> at >>> org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:279) >>> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) >>> at >>> org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:124) >>> at >>> org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:247) >>> at >>> org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:140) >>> at >>> org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131) >>> at >>> org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:382) >>> at >>> org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708) >>> at >>> org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626) >>> at java.lang.Thread.run(Thread.java:748) >>> >>> >>> apilog.log: >>> 2018-02-28 03:00:59,314 INFO [a.c.c.a.ApiServer] >>> (qtp788117692-10:ctx-5560c2b1 ctx-b98fcd2f) (logid:0e4de757) (userId=2 >>> accountId=2 sessionId=node0vg1xfc9xvd911ih4h5xpif3ra0) 82.135.143.87 >>> -- POST >>> command=addCluster&zoneId=50a00553-253f-4b60-b39a-3da0a6deb9c2&hypervisor=KVM&clustertype=CloudManaged&podId=4d482c41-8414-47d0-901f-cb256888c5f0&clustername=PrivateCloudCluster&response=json >>> 200 >>> {"addclusterresponse":{"count":1,"cluster":[{"id":"b0edbd45-f99d-4b0e-a302-364012e1b59e","name":"PrivateCloudCluster","podid":"4d482c41-8414-47d0-901f-cb256888c5f0","podname":"PrivateCloudPod","zoneid":"50a00553-253f-4b60-b39a-3da0a6deb9c2","zonename":"PrivateCloud","hypervisortype":"KVM","clustertype":"CloudManaged","allocationstate":"Enabled","managedstate":"Managed","cpuovercommitratio":"1.0","memoryovercommitratio":"1.0","resourcedetails":{"memoryOvercommitRatio":"1.0","cpuOvercommitRatio":"1.0"}}]}} >>> 2018-02-28 03:02:10,954 INFO [a.c.c.a.ApiServer] >>> (qtp788117692-15:ctx-8f3b4977 ctx-da6bfb2f) (logid:f8587145) (userId=2 >>> accountId=2 sessionId=node0vg1xfc9xvd911ih4h5xpif3ra0) 82.135.143.87 >>> -- POST command=addHost&response=json 530 Index: 0, Size: 0 >>> >>> rohit.ya...@shapeblue.com >>> www.shapeblue.com<http://www.shapeblue.com> >>> 53 Chandos Place, Covent Garden, London WC2N 4HSUK >>> @shapeblue >>> >>> >>>
