Management server is unable to contact Xenserver hosts. I am using CS 4.1.0 and Xenserver 6.1.0
In management-server.log file i see, 2013-07-15 05:21:04,242 DEBUG [agent.manager.ClusteredAgentManagerImpl] (AgentManager-Handler-6:null) Seq 47-454361091: MgmtId 86818918938281: Req: Resource [Host:47] is unreachable: Host 47: Link is closed 2013-07-15 05:21:04,321 INFO [agent.manager.ClusteredAgentManagerImpl] (AgentManager-Handler-3:null) SSL: Handshake done 2013-07-15 05:21:04,321 DEBUG [agent.manager.ClusteredAgentManagerImpl] (AgentManager-Handler-3:null) Connection to peer opened: 86818918938281, ip: 192.168.10.251 2013-07-15 05:21:04,321 DEBUG [agent.manager.ClusteredAgentManagerImpl] (AgentManager-Handler-3:null) Seq 47--1: MgmtId 86818918938281: Req: Routing to peer 2013-07-15 05:21:04,321 DEBUG [agent.manager.ClusteredAgentManagerImpl] (AgentManager-Handler-4:null) Seq 47--1: MgmtId 86818918938281: Req: Routing to peer 2013-07-15 05:21:04,321 DEBUG [agent.manager.ClusteredAgentManagerImpl] (AgentManager-Handler-6:null) Seq 47--1: MgmtId 86818918938281: Req: Routing to peer 2013-07-15 05:21:04,322 DEBUG [agent.manager.ClusteredAgentManagerImpl] (AgentManager-Handler-2:null) Seq 47--1: MgmtId 86818918938281: Req: Routing to peer 2013-07-15 05:21:04,321 DEBUG [agent.manager.ClusteredAgentManagerImpl] (AgentManager-Handler-5:null) Seq 39--1: MgmtId 86818918938281: Req: Routing to peer 2013-07-15 05:21:04,372 DEBUG [agent.manager.ClusteredAgentManagerImpl] (AgentManager-Handler-10:null) Seq 47--1: MgmtId 86818918938281: Req: Cancel request received 2013-07-15 05:21:04,373 DEBUG [agent.manager.AgentAttache] (AgentManager-Handler-10:null) Seq 47-454361091: Cancelling. 2013-07-15 05:21:04,373 DEBUG [agent.manager.ClusteredAgentManagerImpl] (AgentManager-Handler-12:null) Seq 39--1: MgmtId 86818918938281: Req: Cancel request received 2013-07-15 05:21:04,374 DEBUG [agent.manager.ClusteredAgentManagerImpl] (AgentManager-Handler-8:null) Seq 47--1: MgmtId 86818918938281: Req: Cancel request received 2013-07-15 05:21:04,373 DEBUG [agent.manager.AgentAttache] (HA-Worker-4:work-4478) Seq 47-454361091: Waiting some more time because this is the current command 2013-07-15 05:21:04,375 DEBUG [agent.manager.AgentAttache] (HA-Worker-4:work-4478) Seq 47-454361091: Waiting some more time because this is the current command 2013-07-15 05:21:04,375 INFO [utils.exception.CSExceptionErrorCode] (HA-Worker-4:work-4478) Could not find exception: com.cloud.exception.OperationTimedoutException in error code list for exceptions 2013-07-15 05:21:04,374 DEBUG [agent.manager.ClusteredAgentManagerImpl] (AgentManager-Handler-11:null) Seq 47--1: MgmtId 86818918938281: Req: Cancel request received 2013-07-15 05:21:04,376 DEBUG [agent.manager.AgentAttache] (AgentManager-Handler-11:null) Seq 47-454361090: Cancelling. 2013-07-15 05:21:04,376 WARN [agent.manager.AgentAttache] (HA-Worker-4:work-4478) Seq 47-454361091: Timed out on Seq 47-454361091: { Cmd , MgmtId: 86818918938281, via: 47, Ver: v1, Flags: 100011, [{"CheckVirtualMachineCommand":{"vmName":"v-1219-VM","wait":20}}] } 2013-07-15 05:21:04,376 DEBUG [agent.manager.AgentAttache] (HA-Worker-4:work-4478) Seq 47-454361091: Cancelling. 2013-07-15 05:21:04,376 DEBUG [cloud.ha.CheckOnAgentInvestigator] (HA-Worker-4:work-4478) Operation timed out for VM[ConsoleProxy|v-1219-VM]: Commands 454361091 to Host 47 timed out after 40 2013-07-15 05:21:04,376 INFO [cloud.ha.HighAvailabilityManagerImpl] (HA-Worker-4:work-4478) SimpleInvestigator found VM[ConsoleProxy|v-1219-VM]to be alive? null 2013-07-15 05:21:04,378 DEBUG [agent.manager.AgentAttache] (HA-Worker-1:work-4479) Seq 47-454361090: Waiting some more time because this is the current command 2013-07-15 05:21:04,378 DEBUG [agent.manager.AgentAttache] (HA-Worker-1:work-4479) Seq 47-454361090: Waiting some more time because this is the current command 2013-07-15 05:21:04,374 DEBUG [agent.manager.ClusteredAgentManagerImpl] (AgentManager-Handler-9:null) Seq 47--1: MgmtId 86818918938281: Req: Cancel request received 2013-07-15 05:21:04,379 DEBUG [agent.manager.AgentAttache] (AgentManager-Handler-9:null) Seq 47-454361092: Cancelling. In /valr/log/syslog, Jul 15 08:38:42 cstagcms jsvc.exec[4239]: WARN [agent.manager.AgentAttache] (StatsCollector-1:) Seq 47-2132082728: Timed out on null Jul 15 08:38:42 cstagcms jsvc.exec[4239]: INFO [cloud.server.StatsCollector] (StatsCollector-1:) Unable to reach Pool[210|NetworkFilesystem]#012com.cloud.exception.StorageUnavailableException: Resource [StoragePool:210] is unreachable: Unable to send command to the pool #012#011at com.cloud.storage.StorageManagerImpl.sendToPool(StorageManagerImpl.java:2357)#012#011at com.cloud.storage.StorageManagerImpl.sendToPool(StorageManagerImpl.java:422)#012#011at com.cloud.storage.StorageManagerImpl.sendToPool(StorageManagerImpl.java:436)#012#011at com.cloud.server.StatsCollector$StorageCollector.run(StatsCollector.java:316)#012#011at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)#012#011at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:351)#012#011at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178)#012#011at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:165)#012#011at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:267)#012#011at java Jul 15 08:38:42 cstagcms jsvc.exec[4239]: .util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)#012#011at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)#012#011at java.lang.Thread.run(Thread.java:679) Jul 15 08:39:42 cstagcms jsvc.exec[4239]: INFO [utils.exception.CSExceptionErrorCode] (StatsCollector-3:) Could not find exception: com.cloud.exception.OperationTimedoutException in error code list for exceptions Jul 15 08:39:42 cstagcms jsvc.exec[4239]: WARN [agent.manager.AgentAttache] (StatsCollector-3:) Seq 39-1696661556: Timed out on null Jul 15 08:39:42 cstagcms jsvc.exec[4239]: WARN [agent.manager.AgentManagerImpl] (StatsCollector-3:) Operation timed out: Commands 1696661556 to Host 39 timed out after 3600 Jul 15 08:39:42 cstagcms jsvc.exec[4239]: WARN [cloud.resource.ResourceManagerImpl] (StatsCollector-3:) Unable to obtain host 39 statistics. Jul 15 08:39:42 cstagcms jsvc.exec[4239]: WARN [cloud.server.StatsCollector] (StatsCollector-3:) Received invalid host stats for host: 39 Jul 15 08:39:42 cstagcms jsvc.exec[4239]: INFO [utils.exception.CSExceptionErrorCode] (StatsCollector-3:) Could not find exception: com.cloud.exception.OperationTimedoutException in error code list for exceptions Thanks in advance -- Leeno Jose .P.A