Yeah had the same thought. Seems that the cluster master is balking. So yeah, try in XenCenter.
On Fri, Mar 22, 2013 at 1:23 PM, Kirk Jantzer <kirk.jant...@gmail.com>wrote: > You mean through Xen Center? > > > On Fri, Mar 22, 2013 at 2:19 PM, Ahmad Emneina <aemne...@gmail.com> wrote: > > > from the log snippet it seems the host cant join the cluster. can you try > > this out of band from cloudstack, join pool from the host, and see what > you > > get? > > > > > > On Fri, Mar 22, 2013 at 11:10 AM, Kirk Jantzer <kirk.jant...@gmail.com > >wrote: > > > >> There's no entry for that host in host_details :-( > >> > >> > >> On Fri, Mar 22, 2013 at 1:30 PM, Ahmad Emneina <aemne...@gmail.com > >wrote: > >> > >>> have you looked at host_details? There should still be an entry with > the > >>> same host details. I'm not entirely sure if this is safe, but you might > >>> want to back up your db, then delete the entries for the problem host > >>> from > >>> both the cloud.host and cloud.host_details tables. > >>> > >>> > >>> On Fri, Mar 22, 2013 at 9:57 AM, Kirk Jantzer <kirk.jant...@gmail.com > >>> >wrote: > >>> > >>> > Anybody? > >>> > > >>> > > >>> > On Thu, Mar 21, 2013 at 8:58 PM, Kirk Jantzer < > kirk.jant...@gmail.com > >>> > >wrote: > >>> > > >>> > > I deleted the host from cloud.host, as well as any old guests in > >>> > > cloud.vm_instance that had that host as last_host_id. > >>> > > On Mar 21, 2013 8:53 PM, "Jason Davis" <scr...@gmail.com> wrote: > >>> > > > >>> > >> Not in front of my workstation but I bet the UUID in the > cloud.host > >>> > >> portion > >>> > >> of the DB still exists even if it is marked "removed". Easy way to > >>> fix > >>> > >> this > >>> > >> is to slightly change that UUID. > >>> > >> On Mar 21, 2013 2:34 PM, "Kirk Jantzer" <kirk.jant...@gmail.com> > >>> wrote: > >>> > >> > >>> > >> > Background: I evicted a host from my cluster to do some testing > >>> with > >>> > >> some > >>> > >> > other opensource products. When I was done, I reinstalled XS as > I > >>> did > >>> > to > >>> > >> > all the other hosts, however I am unable to add the host back to > >>> the > >>> > >> > cluster. I did find a post about duplicate entries in the db, > so I > >>> > >> deleted > >>> > >> > the entry, but am still unable to add it. Thoughts? > >>> > >> > > >>> > >> > CS 4.0.1 > >>> > >> > XenServer 6.0.2 > >>> > >> > > >>> > >> > Output of /var/log/cloud/management/management-server.log: > >>> > >> > > >>> > >> > 2013-03-21 15:23:11,989 DEBUG [cloud.api.ApiServlet] > >>> > (http-8080-3:null) > >>> > >> > ===START=== <client_ipaddress> -- GET > >>> > >> > > >>> > >> > > >>> > >> > >>> > > >>> > > command=addHost&zoneid=7551e0e8-5c64-4955-b368-cf497bd9fd16&podid=81151bfa-d519-4b1d-92ca-df7ce424460c&clusterid=9ec5ca37-df78-4910-b09f-d9be3bed2269&hypervisor=XenServer&clustertype=CloudManaged&hosttags=&username=root&url=http%3A%2F%2F<host_name>&response=json&sessionkey=LPR4A%2FAuwEtdUbF%2BdvSyLpg7rnA%3D&_=1363893870935 > >>> > >> > 2013-03-21 15:23:12,001 INFO > [cloud.resource.ResourceManagerImpl] > >>> > >> > (http-8080-3:null) Trying to add a new host at http:// > <host_name> > >>> in > >>> > >> data > >>> > >> > center 1 > >>> > >> > 2013-03-21 15:23:12,059 DEBUG > >>> [xen.resource.XenServerConnectionPool] > >>> > >> > (http-8080-3:null) Slave logon to <host_ipaddress> > >>> > >> > 2013-03-21 15:23:12,076 DEBUG > >>> [xen.resource.XenServerConnectionPool] > >>> > >> > (http-8080-3:null) Logging on as the master to <host_ipaddress> > >>> > >> > 2013-03-21 15:23:13,006 WARN > >>> [xen.resource.XenServerConnectionPool] > >>> > >> > (http-8080-3:null) Catch > >>> > com.xensource.xenapi.Types$OperationNotAllowed > >>> > >> > Unable to allow host <host_ipaddress> to join pool > >>> <master_ipaddress> > >>> > >> due > >>> > >> > to You attempted an operation that was not allowed. > >>> > >> > You attempted an operation that was not allowed. > >>> > >> > at > >>> com.xensource.xenapi.Types.checkResponse(Types.java:1572) > >>> > >> > at > >>> > com.xensource.xenapi.Connection.dispatch(Connection.java:368) > >>> > >> > at com.xensource.xenapi.Pool.join(Pool.java:1054) > >>> > >> > at > >>> > >> > > >>> > >> > > >>> > >> > >>> > > >>> > com.cloud.hypervisor.xen.resource.XenServerConnectionPool.join(XenServerConnectionPool.java:785) > >>> > >> > at > >>> > >> > > >>> > >> > > >>> > >> > >>> > > >>> > com.cloud.hypervisor.xen.resource.XenServerConnectionPool.joinPool(XenServerConnectionPool.java:159) > >>> > >> > at > >>> > >> > > >>> > >> > > >>> > >> > >>> > > >>> > com.cloud.hypervisor.xen.discoverer.XcpServerDiscoverer.addHostsToPool(XcpServerDiscoverer.java:407) > >>> > >> > at > >>> > >> > > >>> > >> > > >>> > >> > >>> > > >>> > com.cloud.hypervisor.xen.discoverer.XcpServerDiscoverer.find(XcpServerDiscoverer.java:207) > >>> > >> > at > >>> > >> > > >>> > >> > > >>> > >> > >>> > > >>> > com.cloud.resource.ResourceManagerImpl.discoverHostsFull(ResourceManagerImpl.java:687) > >>> > >> > at > >>> > >> > > >>> > >> > > >>> > >> > >>> > > >>> > com.cloud.resource.ResourceManagerImpl.discoverHosts(ResourceManagerImpl.java:544) > >>> > >> > at > >>> > >> com.cloud.api.commands.AddHostCmd.execute(AddHostCmd.java:140) > >>> > >> > at > >>> > com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:138) > >>> > >> > at > >>> com.cloud.api.ApiServer.queueCommand(ApiServer.java:544) > >>> > >> > at > >>> com.cloud.api.ApiServer.handleRequest(ApiServer.java:423) > >>> > >> > at > >>> > com.cloud.api.ApiServlet.processRequest(ApiServlet.java:312) > >>> > >> > at com.cloud.api.ApiServlet.doGet(ApiServlet.java:64) > >>> > >> > at > >>> > javax.servlet.http.HttpServlet.service(HttpServlet.java:617) > >>> > >> > at > >>> > javax.servlet.http.HttpServlet.service(HttpServlet.java:717) > >>> > >> > at > >>> > >> > > >>> > >> > > >>> > >> > >>> > > >>> > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) > >>> > >> > at > >>> > >> > > >>> > >> > > >>> > >> > >>> > > >>> > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) > >>> > >> > at > >>> > >> > > >>> > >> > > >>> > >> > >>> > > >>> > org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) > >>> > >> > at > >>> > >> > > >>> > >> > > >>> > >> > >>> > > >>> > org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) > >>> > >> > at > >>> > >> > > >>> > >> > > >>> > >> > >>> > > >>> > org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) > >>> > >> > at > >>> > >> > > >>> > >> > > >>> > >> > >>> > > >>> > org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) > >>> > >> > at > >>> > >> > > >>> > >> > >>> > > >>> > org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:555) > >>> > >> > at > >>> > >> > > >>> > >> > > >>> > >> > >>> > > >>> > org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) > >>> > >> > at > >>> > >> > > >>> > >> > >>> > > >>> > org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298) > >>> > >> > at > >>> > >> > > >>> > >> > >>> > > >>> > org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857) > >>> > >> > at > >>> > >> > > >>> > >> > > >>> > >> > >>> > > >>> > org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588) > >>> > >> > at > >>> > >> > > >>> > > org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489) > >>> > >> > at java.lang.Thread.run(Thread.java:679) > >>> > >> > 2013-03-21 15:23:13,007 DEBUG > >>> [xen.resource.XenServerConnectionPool] > >>> > >> > (http-8080-3:null) Host(<host_ipaddress>) unable to Join the > pool > >>> at > >>> > >> > <master_ipaddress> > >>> > >> > 2013-03-21 15:23:13,007 WARN > [xen.discoverer.XcpServerDiscoverer] > >>> > >> > (http-8080-3:null) Unable to join the pool > >>> > >> > 2013-03-21 15:23:13,007 DEBUG > [xen.discoverer.XcpServerDiscoverer] > >>> > >> > (http-8080-3:null) other exceptions: > >>> > >> > com.cloud.exception.DiscoveryException: Unable to join the pool > >>> > >> > com.cloud.exception.DiscoveryException: Unable to join the pool > >>> > >> > at > >>> > >> > > >>> > >> > > >>> > >> > >>> > > >>> > com.cloud.hypervisor.xen.discoverer.XcpServerDiscoverer.addHostsToPool(XcpServerDiscoverer.java:409) > >>> > >> > at > >>> > >> > > >>> > >> > > >>> > >> > >>> > > >>> > com.cloud.hypervisor.xen.discoverer.XcpServerDiscoverer.find(XcpServerDiscoverer.java:207) > >>> > >> > at > >>> > >> > > >>> > >> > > >>> > >> > >>> > > >>> > com.cloud.resource.ResourceManagerImpl.discoverHostsFull(ResourceManagerImpl.java:687) > >>> > >> > at > >>> > >> > > >>> > >> > > >>> > >> > >>> > > >>> > com.cloud.resource.ResourceManagerImpl.discoverHosts(ResourceManagerImpl.java:544) > >>> > >> > at > >>> > >> com.cloud.api.commands.AddHostCmd.execute(AddHostCmd.java:140) > >>> > >> > at > >>> > com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:138) > >>> > >> > at > >>> com.cloud.api.ApiServer.queueCommand(ApiServer.java:544) > >>> > >> > at > >>> com.cloud.api.ApiServer.handleRequest(ApiServer.java:423) > >>> > >> > at > >>> > com.cloud.api.ApiServlet.processRequest(ApiServlet.java:312) > >>> > >> > at com.cloud.api.ApiServlet.doGet(ApiServlet.java:64) > >>> > >> > at > >>> > javax.servlet.http.HttpServlet.service(HttpServlet.java:617) > >>> > >> > at > >>> > javax.servlet.http.HttpServlet.service(HttpServlet.java:717) > >>> > >> > at > >>> > >> > > >>> > >> > > >>> > >> > >>> > > >>> > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) > >>> > >> > at > >>> > >> > > >>> > >> > > >>> > >> > >>> > > >>> > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) > >>> > >> > at > >>> > >> > > >>> > >> > > >>> > >> > >>> > > >>> > org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) > >>> > >> > at > >>> > >> > > >>> > >> > > >>> > >> > >>> > > >>> > org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) > >>> > >> > at > >>> > >> > > >>> > >> > > >>> > >> > >>> > > >>> > org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) > >>> > >> > at > >>> > >> > > >>> > >> > > >>> > >> > >>> > > >>> > org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) > >>> > >> > at > >>> > >> > > >>> > >> > >>> > > >>> > org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:555) > >>> > >> > at > >>> > >> > > >>> > >> > > >>> > >> > >>> > > >>> > org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) > >>> > >> > at > >>> > >> > > >>> > >> > >>> > > >>> > org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298) > >>> > >> > at > >>> > >> > > >>> > >> > >>> > > >>> > org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857) > >>> > >> > at > >>> > >> > > >>> > >> > > >>> > >> > >>> > > >>> > org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588) > >>> > >> > at > >>> > >> > > >>> > > org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489) > >>> > >> > at java.lang.Thread.run(Thread.java:679) > >>> > >> > 2013-03-21 15:23:13,008 WARN > [cloud.resource.ResourceManagerImpl] > >>> > >> > (http-8080-3:null) Unable to find the server resources at > http:// > >>> > >> > <host_name> > >>> > >> > 2013-03-21 15:23:13,008 WARN [api.commands.AddHostCmd] > >>> > >> (http-8080-3:null) > >>> > >> > Exception: > >>> > >> > com.cloud.exception.DiscoveryException: Unable to add the host > >>> > >> > at > >>> > >> > > >>> > >> > > >>> > >> > >>> > > >>> > com.cloud.resource.ResourceManagerImpl.discoverHostsFull(ResourceManagerImpl.java:737) > >>> > >> > at > >>> > >> > > >>> > >> > > >>> > >> > >>> > > >>> > com.cloud.resource.ResourceManagerImpl.discoverHosts(ResourceManagerImpl.java:544) > >>> > >> > at > >>> > >> com.cloud.api.commands.AddHostCmd.execute(AddHostCmd.java:140) > >>> > >> > at > >>> > com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:138) > >>> > >> > at > >>> com.cloud.api.ApiServer.queueCommand(ApiServer.java:544) > >>> > >> > at > >>> com.cloud.api.ApiServer.handleRequest(ApiServer.java:423) > >>> > >> > at > >>> > com.cloud.api.ApiServlet.processRequest(ApiServlet.java:312) > >>> > >> > at com.cloud.api.ApiServlet.doGet(ApiServlet.java:64) > >>> > >> > at > >>> > javax.servlet.http.HttpServlet.service(HttpServlet.java:617) > >>> > >> > at > >>> > javax.servlet.http.HttpServlet.service(HttpServlet.java:717) > >>> > >> > at > >>> > >> > > >>> > >> > > >>> > >> > >>> > > >>> > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) > >>> > >> > at > >>> > >> > > >>> > >> > > >>> > >> > >>> > > >>> > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) > >>> > >> > at > >>> > >> > > >>> > >> > > >>> > >> > >>> > > >>> > org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) > >>> > >> > at > >>> > >> > > >>> > >> > > >>> > >> > >>> > > >>> > org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) > >>> > >> > at > >>> > >> > > >>> > >> > > >>> > >> > >>> > > >>> > org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) > >>> > >> > at > >>> > >> > > >>> > >> > > >>> > >> > >>> > > >>> > org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) > >>> > >> > at > >>> > >> > > >>> > >> > >>> > > >>> > org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:555) > >>> > >> > at > >>> > >> > > >>> > >> > > >>> > >> > >>> > > >>> > org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) > >>> > >> > at > >>> > >> > > >>> > >> > >>> > > >>> > org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298) > >>> > >> > at > >>> > >> > > >>> > >> > >>> > > >>> > org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857) > >>> > >> > at > >>> > >> > > >>> > >> > > >>> > >> > >>> > > >>> > org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588) > >>> > >> > at > >>> > >> > > >>> > > org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489) > >>> > >> > at java.lang.Thread.run(Thread.java:679) > >>> > >> > 2013-03-21 15:23:13,008 WARN [cloud.api.ApiDispatcher] > >>> > >> (http-8080-3:null) > >>> > >> > class com.cloud.api.ServerApiException : Unable to add the host > >>> > >> > 2013-03-21 15:23:13,009 DEBUG [cloud.api.ApiServlet] > >>> > (http-8080-3:null) > >>> > >> > ===END=== <client_ipaddress> -- GET > >>> > >> > > >>> > >> > > >>> > >> > >>> > > >>> > > command=addHost&zoneid=7551e0e8-5c64-4955-b368-cf497bd9fd16&podid=81151bfa-d519-4b1d-92ca-df7ce424460c&clusterid=9ec5ca37-df78-4910-b09f-d9be3bed2269&hypervisor=XenServer&clustertype=CloudManaged&hosttags=&username=root&url=http%3A%2F%2F<host_name>&response=json&sessionkey=LPR4A%2FAuwEtdUbF%2BdvSyLpg7rnA%3D&_=1363893870935 > >>> > >> > > >>> > >> > >>> > > > >>> > > >>> > > >>> > -- > >>> > Regards, > >>> > > >>> > Kirk Jantzer > >>> > c: (678) 561-5475 > >>> > > >>> > >> > >> > >> > >> -- > >> Regards, > >> > >> Kirk Jantzer > >> c: (678) 561-5475 > >> > > > > > > > -- > Regards, > > Kirk Jantzer > c: (678) 561-5475 >
