Re: Import from external host
Hi Jimmy Could you please try the steps mentioned here https://github.com/apache/cloudstack/issues/8704#issuecomment-1963762570 Also please check if the libvirtd process is listenting on the port netstat -tunap|grep 16509 Regards Kiran From: Jimmy Huybrechts Date: Thursday, 29 February 2024 at 2:44 AM To: users@cloudstack.apache.org Subject: Re: Import from external host Took some search indeed but this is what I get in the log: 2024-02-28 22:07:26,036 ERROR [c.c.a.ApiServer] (qtp1753127384-12419:ctx-46cafb61 ctx-360e905b) (logid:72359c47) unhandled exception executing api command: [Ljava.lang.String;@7e8da5b com.cloud.utils.exception.CloudRuntimeException: Error while listing remote Vms at org.apache.cloudstack.vm.UnmanagedVMsManagerImpl.getRemoteVms(UnmanagedVMsManagerImpl.java:2489) at org.apache.cloudstack.vm.UnmanagedVMsManagerImpl.listVmsForImport(UnmanagedVMsManagerImpl.java:2464) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:566) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:215) at com.sun.proxy.$Proxy459.listVmsForImport(Unknown Source) at org.apache.cloudstack.api.command.admin.vm.ListVmsForImportCmd.execute(ListVmsForImportCmd.java:121) at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:172) at com.cloud.api.ApiServer.queueCommand(ApiServer.java:782) at com.cloud.api.ApiServer.handleRequest(ApiServer.java:603) at com.cloud.api.ApiServlet.processRequestInContext(ApiServlet.java:347) at com.cloud.api.ApiServlet$1.run(ApiServlet.java:154) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:55) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:102) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:52) at com.cloud.api.ApiServlet.processRequest(ApiServlet.java:151) at com.cloud.api.ApiServlet.doGet(ApiServlet.java:105) at javax.servlet.http.HttpServlet.service(HttpServlet.java:645) at javax.servlet.http.HttpServlet.service(HttpServlet.java:750) at org.eclipse.jetty.servlet.ServletHolder$NotAsync.service(ServletHolder.java:1450) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:799) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:554) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:600) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1624) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1440) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:505) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1594) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1355) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:772) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:516)
Re: Import from external host
Took some search indeed but this is what I get in the log: 2024-02-28 22:07:26,036 ERROR [c.c.a.ApiServer] (qtp1753127384-12419:ctx-46cafb61 ctx-360e905b) (logid:72359c47) unhandled exception executing api command: [Ljava.lang.String;@7e8da5b com.cloud.utils.exception.CloudRuntimeException: Error while listing remote Vms at org.apache.cloudstack.vm.UnmanagedVMsManagerImpl.getRemoteVms(UnmanagedVMsManagerImpl.java:2489) at org.apache.cloudstack.vm.UnmanagedVMsManagerImpl.listVmsForImport(UnmanagedVMsManagerImpl.java:2464) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:566) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:215) at com.sun.proxy.$Proxy459.listVmsForImport(Unknown Source) at org.apache.cloudstack.api.command.admin.vm.ListVmsForImportCmd.execute(ListVmsForImportCmd.java:121) at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:172) at com.cloud.api.ApiServer.queueCommand(ApiServer.java:782) at com.cloud.api.ApiServer.handleRequest(ApiServer.java:603) at com.cloud.api.ApiServlet.processRequestInContext(ApiServlet.java:347) at com.cloud.api.ApiServlet$1.run(ApiServlet.java:154) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:55) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:102) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:52) at com.cloud.api.ApiServlet.processRequest(ApiServlet.java:151) at com.cloud.api.ApiServlet.doGet(ApiServlet.java:105) at javax.servlet.http.HttpServlet.service(HttpServlet.java:645) at javax.servlet.http.HttpServlet.service(HttpServlet.java:750) at org.eclipse.jetty.servlet.ServletHolder$NotAsync.service(ServletHolder.java:1450) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:799) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:554) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:600) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1624) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1440) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:505) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1594) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1355) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:772) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:516) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277) at
Re: Import from external host
right, cloudsack-agent is not needed on the remote server. However, cloudstack selects a host (already managed by cloudstack) to connect to the libvirt daemon (listen on port 16509) of the remote server to get all the vms. You can search "GetRemoteVms" in the management server log. -Wei On Wed, Feb 28, 2024 at 7:08 PM Jimmy Huybrechts wrote: > Hmm wait you need the cloudagent on the remote host as well? I would have > expected that not be needed right? > Which log should I look at? The management-server log? As I didn’t see > anything in there except for what I did include. > > -- > Jimmy > > Van: Wei ZHOU > Datum: woensdag, 28 februari 2024 om 17:15 > Aan: users@cloudstack.apache.org > Onderwerp: Re: Import from external host > Any exception in the log? > > I wonder if it is similar as > https://github.com/apache/cloudstack/issues/8704#issuecomment-1963762570 > > -Wei > > On Wednesday, February 28, 2024, Jimmy Huybrechts > wrote: > > > I’m trying to import vm’s from an external KVM host. I built a test KVM > > host with 5 virtual machines of which 4 are on and one is off. > > Libvirt is listening on tcp port 16509. > > > > When trying to fetch instances I get “Request failed. (530) Error while > > listing remote Vms” > > > > As host I’m using the KVM host IP of course, and the user and password > are > > that of my root user. (opened root access for this case). > > > > Is there some log I can see as to why I get that error? On the > > management-server log I only see: > > [28/Feb/2024:16:00:09 +] "GET /client/api/?zoneid=00122c1c- > > 89ae-4fbf-8424-e8619a787d39=1=10= > > > KVMHOSTIP=root=PASSWORDFORHOST=kvm=listVmsForImport=json > > HTTP/1.1" 530 124 > > > > -- > > Jimmy > > >
Re: Storage in avoid set
Hi Alex, The tags are the disk offering tags. Anyway , can you share the full log of the job ? -Wei On Wed, Feb 28, 2024 at 6:47 PM Alex Paul wrote: > Hi Wei, > > No tags are there. I think in logs also its not printing to any tags: > > > Found pools [[Pool[1|PreSetup]]] that match with tags [[]]. > > The VM deployments were fine 2 days before. All in a sudden it started > failing. > > > Alex > > On Wednesday, February 28, 2024, Wei ZHOU wrote: > > > Agree. > > > > Please also check if the pool has any tags. > > > > -Wei > > > > On Wed, Feb 28, 2024 at 5:31 PM Slavka Peleva > > > > > wrote: > > > > > Hi Alex, > > > > > > Sorry for the question but is it possible that the cluster is > disabled? I > > > have faced a similar problem before while testing. > > > > > > Best regards, > > > Slavka > > > > > > On Wed, Feb 28, 2024 at 5:15 PM Alex Paul > > > > wrote: > > > > > > > Hi Swen, > > > > > > > > Yes, only 3TB used out of 15TB and double checked the threshold is at > > > 85%. > > > > :( > > > > > > > > Alex > > > > > > > > On Wed, Feb 28, 2024 at 7:32 PM wrote: > > > > > > > > > Hi Alex, > > > > > > > > > > is there enough free space on the storage? Check your thresholds in > > > > global > > > > > settings. > > > > > > > > > > Regards, > > > > > Swen > > > > > > > > > > -Ursprüngliche Nachricht- > > > > > Von: Alex Paul > > > > > Gesendet: Mittwoch, 28. Februar 2024 14:24 > > > > > An: users@cloudstack.apache.org > > > > > Betreff: Storage in avoid set > > > > > > > > > > Hello Team, > > > > > > > > > > We've encountered an issue with our cloudstack setup on 3 XCP-ng > > hosts. > > > > > Suddenly, VM deployments are failing. > > > > > > > > > > Our configuration includes a primary storage of type 'presetup' > using > > > > HBA. > > > > > Interestingly, the storage functions properly in the XEN cluster, > > > > allowing > > > > > us to deploy VMs directly in xen. > > > > > > > > > > However, in cloudstack, deployments are failing with the following > > > logs: > > > > > "StoragePool is in avoid set, skipping this pool." > > > > > > > > > > Could someone please provide guidance on why it's in the avoid set > > and > > > > how > > > > > we can remove it from there? > > > > > > > > > > Full logs are provided below for reference. > > > > > > > > > > > > > > > 024-02-27 11:24:04,879 DEBUG > > > [o.a.c.s.a.ClusterScopeStoragePoolAllocator] > > > > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 > > > > > ctx-02929e21) (logid:97976fdd) Looking for pools in dc [1], pod > [1] > > > and > > > > > cluster [1]. Disabled pools will be ignored. > > > > > 2024-02-27 11:24:04,881 DEBUG > > > > [o.a.c.s.a.ClusterScopeStoragePoolAllocator] > > > > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 > > > > > ctx-02929e21) (logid:97976fdd) Found pools [[Pool[1|PreSetup]]] > that > > > > > match with tags [[]]. > > > > > 2024-02-27 11:24:04,885 DEBUG [o.a.c.s.a. > > AbstractStoragePoolAllocator] > > > > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx > > > > > -02929e21) (logid:97976fdd) Checking if storage pool is suitable, > > name: > > > > > CLOUDSTACKVOL1 ,poolId: 1 > > > > > 2024-02-27 11:24:04,885 DEBUG [o.a.c.s.a. > > AbstractStoragePoolAllocator] > > > > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > > > > > (logid:97976fdd) StoragePool is in avoid set, skipping this pool > > > > > 2024-02-27 11:24:04,885 DEBUG [o.a.c.s.a. > > AbstractStoragePoolAllocator] > > > > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > > > > > (logid:97976fdd) ClusterScopeStoragePoolAllocator is returning [0] > > > > > suitable storage pools [[]]. > > > > > 2024-02-27 11:24:04,891 DEBUG [o.a.c.s.a. > > AbstractStoragePoolAllocator] > > > > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > > > > > (logid:97976fdd) ZoneWideStoragePoolAllocator is returning [0] > > suitable > > > > > storage pools [[]]. > > > > > 2024-02-27 11:24:04,891 DEBUG [c.c.d.DeploymentPlanningManagerImpl] > > > > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > > > > > (logid:97976fdd) No suitable pools found for volume: > > > > > Vol[1182|name=ROOT-1133|vm=1133|ROOT] under cluster: 1 > > > > > 2024-02-27 11:24:04,891 DEBUG [c.c.d.DeploymentPlanningManagerImpl] > > > > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > > > > > (logid:97976fdd) No suitable pools found > > > > > 2024-02-27 11:24:04,891 DEBUG [c.c.d.DeploymentPlanningManagerImpl] > > > > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > > > > > (logid:97976fdd) No suitable storagePools found under this > Cluster: 1 > > > > > 2024-02-27 11:24:04,898 DEBUG [c.c.d.DeploymentPlanningManagerImpl] > > > > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > > > > > (logid:97976fdd) Could not find suitable Deployment Destination for > > > this > > > > > VM under any clusters, returning. > > > > > 2024-02-27
Re: Import from external host
Hmm wait you need the cloudagent on the remote host as well? I would have expected that not be needed right? Which log should I look at? The management-server log? As I didn’t see anything in there except for what I did include. -- Jimmy Van: Wei ZHOU Datum: woensdag, 28 februari 2024 om 17:15 Aan: users@cloudstack.apache.org Onderwerp: Re: Import from external host Any exception in the log? I wonder if it is similar as https://github.com/apache/cloudstack/issues/8704#issuecomment-1963762570 -Wei On Wednesday, February 28, 2024, Jimmy Huybrechts wrote: > I’m trying to import vm’s from an external KVM host. I built a test KVM > host with 5 virtual machines of which 4 are on and one is off. > Libvirt is listening on tcp port 16509. > > When trying to fetch instances I get “Request failed. (530) Error while > listing remote Vms” > > As host I’m using the KVM host IP of course, and the user and password are > that of my root user. (opened root access for this case). > > Is there some log I can see as to why I get that error? On the > management-server log I only see: > [28/Feb/2024:16:00:09 +] "GET /client/api/?zoneid=00122c1c- > 89ae-4fbf-8424-e8619a787d39=1=10= > KVMHOSTIP=root=PASSWORDFORHOST=kvm=listVmsForImport=json > HTTP/1.1" 530 124 > > -- > Jimmy >
Re: Storage in avoid set
Hi Wei, No tags are there. I think in logs also its not printing to any tags: Found pools [[Pool[1|PreSetup]]] that match with tags [[]]. The VM deployments were fine 2 days before. All in a sudden it started failing. Alex On Wednesday, February 28, 2024, Wei ZHOU wrote: > Agree. > > Please also check if the pool has any tags. > > -Wei > > On Wed, Feb 28, 2024 at 5:31 PM Slavka Peleva > > wrote: > > > Hi Alex, > > > > Sorry for the question but is it possible that the cluster is disabled? I > > have faced a similar problem before while testing. > > > > Best regards, > > Slavka > > > > On Wed, Feb 28, 2024 at 5:15 PM Alex Paul > > wrote: > > > > > Hi Swen, > > > > > > Yes, only 3TB used out of 15TB and double checked the threshold is at > > 85%. > > > :( > > > > > > Alex > > > > > > On Wed, Feb 28, 2024 at 7:32 PM wrote: > > > > > > > Hi Alex, > > > > > > > > is there enough free space on the storage? Check your thresholds in > > > global > > > > settings. > > > > > > > > Regards, > > > > Swen > > > > > > > > -Ursprüngliche Nachricht- > > > > Von: Alex Paul > > > > Gesendet: Mittwoch, 28. Februar 2024 14:24 > > > > An: users@cloudstack.apache.org > > > > Betreff: Storage in avoid set > > > > > > > > Hello Team, > > > > > > > > We've encountered an issue with our cloudstack setup on 3 XCP-ng > hosts. > > > > Suddenly, VM deployments are failing. > > > > > > > > Our configuration includes a primary storage of type 'presetup' using > > > HBA. > > > > Interestingly, the storage functions properly in the XEN cluster, > > > allowing > > > > us to deploy VMs directly in xen. > > > > > > > > However, in cloudstack, deployments are failing with the following > > logs: > > > > "StoragePool is in avoid set, skipping this pool." > > > > > > > > Could someone please provide guidance on why it's in the avoid set > and > > > how > > > > we can remove it from there? > > > > > > > > Full logs are provided below for reference. > > > > > > > > > > > > 024-02-27 11:24:04,879 DEBUG > > [o.a.c.s.a.ClusterScopeStoragePoolAllocator] > > > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 > > > > ctx-02929e21) (logid:97976fdd) Looking for pools in dc [1], pod [1] > > and > > > > cluster [1]. Disabled pools will be ignored. > > > > 2024-02-27 11:24:04,881 DEBUG > > > [o.a.c.s.a.ClusterScopeStoragePoolAllocator] > > > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 > > > > ctx-02929e21) (logid:97976fdd) Found pools [[Pool[1|PreSetup]]] that > > > > match with tags [[]]. > > > > 2024-02-27 11:24:04,885 DEBUG [o.a.c.s.a. > AbstractStoragePoolAllocator] > > > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx > > > > -02929e21) (logid:97976fdd) Checking if storage pool is suitable, > name: > > > > CLOUDSTACKVOL1 ,poolId: 1 > > > > 2024-02-27 11:24:04,885 DEBUG [o.a.c.s.a. > AbstractStoragePoolAllocator] > > > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > > > > (logid:97976fdd) StoragePool is in avoid set, skipping this pool > > > > 2024-02-27 11:24:04,885 DEBUG [o.a.c.s.a. > AbstractStoragePoolAllocator] > > > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > > > > (logid:97976fdd) ClusterScopeStoragePoolAllocator is returning [0] > > > > suitable storage pools [[]]. > > > > 2024-02-27 11:24:04,891 DEBUG [o.a.c.s.a. > AbstractStoragePoolAllocator] > > > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > > > > (logid:97976fdd) ZoneWideStoragePoolAllocator is returning [0] > suitable > > > > storage pools [[]]. > > > > 2024-02-27 11:24:04,891 DEBUG [c.c.d.DeploymentPlanningManagerImpl] > > > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > > > > (logid:97976fdd) No suitable pools found for volume: > > > > Vol[1182|name=ROOT-1133|vm=1133|ROOT] under cluster: 1 > > > > 2024-02-27 11:24:04,891 DEBUG [c.c.d.DeploymentPlanningManagerImpl] > > > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > > > > (logid:97976fdd) No suitable pools found > > > > 2024-02-27 11:24:04,891 DEBUG [c.c.d.DeploymentPlanningManagerImpl] > > > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > > > > (logid:97976fdd) No suitable storagePools found under this Cluster: 1 > > > > 2024-02-27 11:24:04,898 DEBUG [c.c.d.DeploymentPlanningManagerImpl] > > > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > > > > (logid:97976fdd) Could not find suitable Deployment Destination for > > this > > > > VM under any clusters, returning. > > > > 2024-02-27 11:24:04,900 DEBUG [c.c.d.FirstFitPlanner] > > > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > > > > (logid:97976fdd) Searching all possible resources under this Zone: 1 > > > > 2024-02-27 11:24:04,903 DEBUG [c.c.d.FirstFitPlanner] > > > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > > > > (logid:97976fdd) Listing clusters in order of aggregate capacity, > that > > > > have (at
Re: Storage in avoid set
Hi Slavak, No. The cluster is enabled. Tried adding new temporary primary storage and deployments are fine there. Alex On Wednesday, February 28, 2024, Slavka Peleva wrote: > Hi Alex, > > Sorry for the question but is it possible that the cluster is disabled? I > have faced a similar problem before while testing. > > Best regards, > Slavka > > On Wed, Feb 28, 2024 at 5:15 PM Alex Paul > wrote: > > > Hi Swen, > > > > Yes, only 3TB used out of 15TB and double checked the threshold is at > 85%. > > :( > > > > Alex > > > > On Wed, Feb 28, 2024 at 7:32 PM wrote: > > > > > Hi Alex, > > > > > > is there enough free space on the storage? Check your thresholds in > > global > > > settings. > > > > > > Regards, > > > Swen > > > > > > -Ursprüngliche Nachricht- > > > Von: Alex Paul > > > Gesendet: Mittwoch, 28. Februar 2024 14:24 > > > An: users@cloudstack.apache.org > > > Betreff: Storage in avoid set > > > > > > Hello Team, > > > > > > We've encountered an issue with our cloudstack setup on 3 XCP-ng hosts. > > > Suddenly, VM deployments are failing. > > > > > > Our configuration includes a primary storage of type 'presetup' using > > HBA. > > > Interestingly, the storage functions properly in the XEN cluster, > > allowing > > > us to deploy VMs directly in xen. > > > > > > However, in cloudstack, deployments are failing with the following > logs: > > > "StoragePool is in avoid set, skipping this pool." > > > > > > Could someone please provide guidance on why it's in the avoid set and > > how > > > we can remove it from there? > > > > > > Full logs are provided below for reference. > > > > > > > > > 024-02-27 11:24:04,879 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocat > or] > > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 > > > ctx-02929e21) (logid:97976fdd) Looking for pools in dc [1], pod [1] > and > > > cluster [1]. Disabled pools will be ignored. > > > 2024-02-27 11:24:04,881 DEBUG > > [o.a.c.s.a.ClusterScopeStoragePoolAllocator] > > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 > > > ctx-02929e21) (logid:97976fdd) Found pools [[Pool[1|PreSetup]]] that > > > match with tags [[]]. > > > 2024-02-27 11:24:04,885 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator] > > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx > > > -02929e21) (logid:97976fdd) Checking if storage pool is suitable, name: > > > CLOUDSTACKVOL1 ,poolId: 1 > > > 2024-02-27 11:24:04,885 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator] > > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > > > (logid:97976fdd) StoragePool is in avoid set, skipping this pool > > > 2024-02-27 11:24:04,885 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator] > > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > > > (logid:97976fdd) ClusterScopeStoragePoolAllocator is returning [0] > > > suitable storage pools [[]]. > > > 2024-02-27 11:24:04,891 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator] > > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > > > (logid:97976fdd) ZoneWideStoragePoolAllocator is returning [0] suitable > > > storage pools [[]]. > > > 2024-02-27 11:24:04,891 DEBUG [c.c.d.DeploymentPlanningManagerImpl] > > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > > > (logid:97976fdd) No suitable pools found for volume: > > > Vol[1182|name=ROOT-1133|vm=1133|ROOT] under cluster: 1 > > > 2024-02-27 11:24:04,891 DEBUG [c.c.d.DeploymentPlanningManagerImpl] > > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > > > (logid:97976fdd) No suitable pools found > > > 2024-02-27 11:24:04,891 DEBUG [c.c.d.DeploymentPlanningManagerImpl] > > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > > > (logid:97976fdd) No suitable storagePools found under this Cluster: 1 > > > 2024-02-27 11:24:04,898 DEBUG [c.c.d.DeploymentPlanningManagerImpl] > > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > > > (logid:97976fdd) Could not find suitable Deployment Destination for > this > > > VM under any clusters, returning. > > > 2024-02-27 11:24:04,900 DEBUG [c.c.d.FirstFitPlanner] > > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > > > (logid:97976fdd) Searching all possible resources under this Zone: 1 > > > 2024-02-27 11:24:04,903 DEBUG [c.c.d.FirstFitPlanner] > > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > > > (logid:97976fdd) Listing clusters in order of aggregate capacity, that > > > have (at least one host with) enough CPU and RAM capacity under this > > Zone: 1 > > > 2024-02-27 11:24:04,910 DEBUG [c.c.d.FirstFitPlanner] > > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > > > (logid:97976fdd) Removing from the clusterId list these clusters from > > avoid > > > set: [1] > > > 2024-02-27 11:24:04,911 DEBUG [c.c.d.FirstFitPlanner] > > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > > > (logid:97976fdd) No
Re: Storage in avoid set
Agree. Please also check if the pool has any tags. -Wei On Wed, Feb 28, 2024 at 5:31 PM Slavka Peleva wrote: > Hi Alex, > > Sorry for the question but is it possible that the cluster is disabled? I > have faced a similar problem before while testing. > > Best regards, > Slavka > > On Wed, Feb 28, 2024 at 5:15 PM Alex Paul > wrote: > > > Hi Swen, > > > > Yes, only 3TB used out of 15TB and double checked the threshold is at > 85%. > > :( > > > > Alex > > > > On Wed, Feb 28, 2024 at 7:32 PM wrote: > > > > > Hi Alex, > > > > > > is there enough free space on the storage? Check your thresholds in > > global > > > settings. > > > > > > Regards, > > > Swen > > > > > > -Ursprüngliche Nachricht- > > > Von: Alex Paul > > > Gesendet: Mittwoch, 28. Februar 2024 14:24 > > > An: users@cloudstack.apache.org > > > Betreff: Storage in avoid set > > > > > > Hello Team, > > > > > > We've encountered an issue with our cloudstack setup on 3 XCP-ng hosts. > > > Suddenly, VM deployments are failing. > > > > > > Our configuration includes a primary storage of type 'presetup' using > > HBA. > > > Interestingly, the storage functions properly in the XEN cluster, > > allowing > > > us to deploy VMs directly in xen. > > > > > > However, in cloudstack, deployments are failing with the following > logs: > > > "StoragePool is in avoid set, skipping this pool." > > > > > > Could someone please provide guidance on why it's in the avoid set and > > how > > > we can remove it from there? > > > > > > Full logs are provided below for reference. > > > > > > > > > 024-02-27 11:24:04,879 DEBUG > [o.a.c.s.a.ClusterScopeStoragePoolAllocator] > > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 > > > ctx-02929e21) (logid:97976fdd) Looking for pools in dc [1], pod [1] > and > > > cluster [1]. Disabled pools will be ignored. > > > 2024-02-27 11:24:04,881 DEBUG > > [o.a.c.s.a.ClusterScopeStoragePoolAllocator] > > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 > > > ctx-02929e21) (logid:97976fdd) Found pools [[Pool[1|PreSetup]]] that > > > match with tags [[]]. > > > 2024-02-27 11:24:04,885 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator] > > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx > > > -02929e21) (logid:97976fdd) Checking if storage pool is suitable, name: > > > CLOUDSTACKVOL1 ,poolId: 1 > > > 2024-02-27 11:24:04,885 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator] > > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > > > (logid:97976fdd) StoragePool is in avoid set, skipping this pool > > > 2024-02-27 11:24:04,885 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator] > > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > > > (logid:97976fdd) ClusterScopeStoragePoolAllocator is returning [0] > > > suitable storage pools [[]]. > > > 2024-02-27 11:24:04,891 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator] > > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > > > (logid:97976fdd) ZoneWideStoragePoolAllocator is returning [0] suitable > > > storage pools [[]]. > > > 2024-02-27 11:24:04,891 DEBUG [c.c.d.DeploymentPlanningManagerImpl] > > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > > > (logid:97976fdd) No suitable pools found for volume: > > > Vol[1182|name=ROOT-1133|vm=1133|ROOT] under cluster: 1 > > > 2024-02-27 11:24:04,891 DEBUG [c.c.d.DeploymentPlanningManagerImpl] > > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > > > (logid:97976fdd) No suitable pools found > > > 2024-02-27 11:24:04,891 DEBUG [c.c.d.DeploymentPlanningManagerImpl] > > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > > > (logid:97976fdd) No suitable storagePools found under this Cluster: 1 > > > 2024-02-27 11:24:04,898 DEBUG [c.c.d.DeploymentPlanningManagerImpl] > > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > > > (logid:97976fdd) Could not find suitable Deployment Destination for > this > > > VM under any clusters, returning. > > > 2024-02-27 11:24:04,900 DEBUG [c.c.d.FirstFitPlanner] > > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > > > (logid:97976fdd) Searching all possible resources under this Zone: 1 > > > 2024-02-27 11:24:04,903 DEBUG [c.c.d.FirstFitPlanner] > > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > > > (logid:97976fdd) Listing clusters in order of aggregate capacity, that > > > have (at least one host with) enough CPU and RAM capacity under this > > Zone: 1 > > > 2024-02-27 11:24:04,910 DEBUG [c.c.d.FirstFitPlanner] > > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > > > (logid:97976fdd) Removing from the clusterId list these clusters from > > avoid > > > set: [1] > > > 2024-02-27 11:24:04,911 DEBUG [c.c.d.FirstFitPlanner] > > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > > > (logid:97976fdd) No clusters found after removing disabled clusters and > > > clusters
Re: Storage in avoid set
Hi Alex, Sorry for the question but is it possible that the cluster is disabled? I have faced a similar problem before while testing. Best regards, Slavka On Wed, Feb 28, 2024 at 5:15 PM Alex Paul wrote: > Hi Swen, > > Yes, only 3TB used out of 15TB and double checked the threshold is at 85%. > :( > > Alex > > On Wed, Feb 28, 2024 at 7:32 PM wrote: > > > Hi Alex, > > > > is there enough free space on the storage? Check your thresholds in > global > > settings. > > > > Regards, > > Swen > > > > -Ursprüngliche Nachricht- > > Von: Alex Paul > > Gesendet: Mittwoch, 28. Februar 2024 14:24 > > An: users@cloudstack.apache.org > > Betreff: Storage in avoid set > > > > Hello Team, > > > > We've encountered an issue with our cloudstack setup on 3 XCP-ng hosts. > > Suddenly, VM deployments are failing. > > > > Our configuration includes a primary storage of type 'presetup' using > HBA. > > Interestingly, the storage functions properly in the XEN cluster, > allowing > > us to deploy VMs directly in xen. > > > > However, in cloudstack, deployments are failing with the following logs: > > "StoragePool is in avoid set, skipping this pool." > > > > Could someone please provide guidance on why it's in the avoid set and > how > > we can remove it from there? > > > > Full logs are provided below for reference. > > > > > > 024-02-27 11:24:04,879 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 > > ctx-02929e21) (logid:97976fdd) Looking for pools in dc [1], pod [1] and > > cluster [1]. Disabled pools will be ignored. > > 2024-02-27 11:24:04,881 DEBUG > [o.a.c.s.a.ClusterScopeStoragePoolAllocator] > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 > > ctx-02929e21) (logid:97976fdd) Found pools [[Pool[1|PreSetup]]] that > > match with tags [[]]. > > 2024-02-27 11:24:04,885 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator] > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx > > -02929e21) (logid:97976fdd) Checking if storage pool is suitable, name: > > CLOUDSTACKVOL1 ,poolId: 1 > > 2024-02-27 11:24:04,885 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator] > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > > (logid:97976fdd) StoragePool is in avoid set, skipping this pool > > 2024-02-27 11:24:04,885 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator] > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > > (logid:97976fdd) ClusterScopeStoragePoolAllocator is returning [0] > > suitable storage pools [[]]. > > 2024-02-27 11:24:04,891 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator] > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > > (logid:97976fdd) ZoneWideStoragePoolAllocator is returning [0] suitable > > storage pools [[]]. > > 2024-02-27 11:24:04,891 DEBUG [c.c.d.DeploymentPlanningManagerImpl] > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > > (logid:97976fdd) No suitable pools found for volume: > > Vol[1182|name=ROOT-1133|vm=1133|ROOT] under cluster: 1 > > 2024-02-27 11:24:04,891 DEBUG [c.c.d.DeploymentPlanningManagerImpl] > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > > (logid:97976fdd) No suitable pools found > > 2024-02-27 11:24:04,891 DEBUG [c.c.d.DeploymentPlanningManagerImpl] > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > > (logid:97976fdd) No suitable storagePools found under this Cluster: 1 > > 2024-02-27 11:24:04,898 DEBUG [c.c.d.DeploymentPlanningManagerImpl] > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > > (logid:97976fdd) Could not find suitable Deployment Destination for this > > VM under any clusters, returning. > > 2024-02-27 11:24:04,900 DEBUG [c.c.d.FirstFitPlanner] > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > > (logid:97976fdd) Searching all possible resources under this Zone: 1 > > 2024-02-27 11:24:04,903 DEBUG [c.c.d.FirstFitPlanner] > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > > (logid:97976fdd) Listing clusters in order of aggregate capacity, that > > have (at least one host with) enough CPU and RAM capacity under this > Zone: 1 > > 2024-02-27 11:24:04,910 DEBUG [c.c.d.FirstFitPlanner] > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > > (logid:97976fdd) Removing from the clusterId list these clusters from > avoid > > set: [1] > > 2024-02-27 11:24:04,911 DEBUG [c.c.d.FirstFitPlanner] > > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > > (logid:97976fdd) No clusters found after removing disabled clusters and > > clusters in avoid list, returning. > > > > > > > > Alexi > > > > > > >
Re: Import from external host
Any exception in the log? I wonder if it is similar as https://github.com/apache/cloudstack/issues/8704#issuecomment-1963762570 -Wei On Wednesday, February 28, 2024, Jimmy Huybrechts wrote: > I’m trying to import vm’s from an external KVM host. I built a test KVM > host with 5 virtual machines of which 4 are on and one is off. > Libvirt is listening on tcp port 16509. > > When trying to fetch instances I get “Request failed. (530) Error while > listing remote Vms” > > As host I’m using the KVM host IP of course, and the user and password are > that of my root user. (opened root access for this case). > > Is there some log I can see as to why I get that error? On the > management-server log I only see: > [28/Feb/2024:16:00:09 +] "GET /client/api/?zoneid=00122c1c- > 89ae-4fbf-8424-e8619a787d39=1=10= > KVMHOSTIP=root=PASSWORDFORHOST=kvm=listVmsForImport=json > HTTP/1.1" 530 124 > > -- > Jimmy >
Import from external host
I’m trying to import vm’s from an external KVM host. I built a test KVM host with 5 virtual machines of which 4 are on and one is off. Libvirt is listening on tcp port 16509. When trying to fetch instances I get “Request failed. (530) Error while listing remote Vms” As host I’m using the KVM host IP of course, and the user and password are that of my root user. (opened root access for this case). Is there some log I can see as to why I get that error? On the management-server log I only see: [28/Feb/2024:16:00:09 +] "GET /client/api/?zoneid=00122c1c-89ae-4fbf-8424-e8619a787d39=1=10=KVMHOSTIP=root=PASSWORDFORHOST=kvm=listVmsForImport=json HTTP/1.1" 530 124 -- Jimmy
CSEUG - September, Germany
Hi all, I would like to propose to organise the CSEUG next meeting on September 12th in Germany. I already had a few informal conversations with community members in Germany, who are willing to help. Do you all think the date is OK and we can meet there? I consider the usual formal of half day talks and will need 5-6 speakers on place. Best regards,
Re: Storage in avoid set
Hi Swen, Yes, only 3TB used out of 15TB and double checked the threshold is at 85%. :( Alex On Wed, Feb 28, 2024 at 7:32 PM wrote: > Hi Alex, > > is there enough free space on the storage? Check your thresholds in global > settings. > > Regards, > Swen > > -Ursprüngliche Nachricht- > Von: Alex Paul > Gesendet: Mittwoch, 28. Februar 2024 14:24 > An: users@cloudstack.apache.org > Betreff: Storage in avoid set > > Hello Team, > > We've encountered an issue with our cloudstack setup on 3 XCP-ng hosts. > Suddenly, VM deployments are failing. > > Our configuration includes a primary storage of type 'presetup' using HBA. > Interestingly, the storage functions properly in the XEN cluster, allowing > us to deploy VMs directly in xen. > > However, in cloudstack, deployments are failing with the following logs: > "StoragePool is in avoid set, skipping this pool." > > Could someone please provide guidance on why it's in the avoid set and how > we can remove it from there? > > Full logs are provided below for reference. > > > 024-02-27 11:24:04,879 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 > ctx-02929e21) (logid:97976fdd) Looking for pools in dc [1], pod [1] and > cluster [1]. Disabled pools will be ignored. > 2024-02-27 11:24:04,881 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 > ctx-02929e21) (logid:97976fdd) Found pools [[Pool[1|PreSetup]]] that > match with tags [[]]. > 2024-02-27 11:24:04,885 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator] > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx > -02929e21) (logid:97976fdd) Checking if storage pool is suitable, name: > CLOUDSTACKVOL1 ,poolId: 1 > 2024-02-27 11:24:04,885 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator] > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > (logid:97976fdd) StoragePool is in avoid set, skipping this pool > 2024-02-27 11:24:04,885 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator] > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > (logid:97976fdd) ClusterScopeStoragePoolAllocator is returning [0] > suitable storage pools [[]]. > 2024-02-27 11:24:04,891 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator] > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > (logid:97976fdd) ZoneWideStoragePoolAllocator is returning [0] suitable > storage pools [[]]. > 2024-02-27 11:24:04,891 DEBUG [c.c.d.DeploymentPlanningManagerImpl] > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > (logid:97976fdd) No suitable pools found for volume: > Vol[1182|name=ROOT-1133|vm=1133|ROOT] under cluster: 1 > 2024-02-27 11:24:04,891 DEBUG [c.c.d.DeploymentPlanningManagerImpl] > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > (logid:97976fdd) No suitable pools found > 2024-02-27 11:24:04,891 DEBUG [c.c.d.DeploymentPlanningManagerImpl] > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > (logid:97976fdd) No suitable storagePools found under this Cluster: 1 > 2024-02-27 11:24:04,898 DEBUG [c.c.d.DeploymentPlanningManagerImpl] > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > (logid:97976fdd) Could not find suitable Deployment Destination for this > VM under any clusters, returning. > 2024-02-27 11:24:04,900 DEBUG [c.c.d.FirstFitPlanner] > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > (logid:97976fdd) Searching all possible resources under this Zone: 1 > 2024-02-27 11:24:04,903 DEBUG [c.c.d.FirstFitPlanner] > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > (logid:97976fdd) Listing clusters in order of aggregate capacity, that > have (at least one host with) enough CPU and RAM capacity under this Zone: 1 > 2024-02-27 11:24:04,910 DEBUG [c.c.d.FirstFitPlanner] > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > (logid:97976fdd) Removing from the clusterId list these clusters from avoid > set: [1] > 2024-02-27 11:24:04,911 DEBUG [c.c.d.FirstFitPlanner] > (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) > (logid:97976fdd) No clusters found after removing disabled clusters and > clusters in avoid list, returning. > > > > Alexi > > >
Community Over Code EU - Agenda is Live
Hi all, I would like to announce that the Community Over Code EU agenda is live here: https://eu.communityovercode.org/schedule/ As you know, we have a whole Apache CloudStacl Track approved including the following sessions inside. (See below) I would like to ask all approved speakers to plan their trip for the event and to apply for the necessary VISAs and documents if needed. Also Ould like to encourage all community members to register for the event here: https://eu.communityovercode.org/tickets/ Early bird is now available! [PastedGraphic-1.png] Best regards,
AW: Storage in avoid set
Hi Alex, is there enough free space on the storage? Check your thresholds in global settings. Regards, Swen -Ursprüngliche Nachricht- Von: Alex Paul Gesendet: Mittwoch, 28. Februar 2024 14:24 An: users@cloudstack.apache.org Betreff: Storage in avoid set Hello Team, We've encountered an issue with our cloudstack setup on 3 XCP-ng hosts. Suddenly, VM deployments are failing. Our configuration includes a primary storage of type 'presetup' using HBA. Interestingly, the storage functions properly in the XEN cluster, allowing us to deploy VMs directly in xen. However, in cloudstack, deployments are failing with the following logs: "StoragePool is in avoid set, skipping this pool." Could someone please provide guidance on why it's in the avoid set and how we can remove it from there? Full logs are provided below for reference. 024-02-27 11:24:04,879 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) (logid:97976fdd) Looking for pools in dc [1], pod [1] and cluster [1]. Disabled pools will be ignored. 2024-02-27 11:24:04,881 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) (logid:97976fdd) Found pools [[Pool[1|PreSetup]]] that match with tags [[]]. 2024-02-27 11:24:04,885 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator] (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx -02929e21) (logid:97976fdd) Checking if storage pool is suitable, name: CLOUDSTACKVOL1 ,poolId: 1 2024-02-27 11:24:04,885 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator] (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) (logid:97976fdd) StoragePool is in avoid set, skipping this pool 2024-02-27 11:24:04,885 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator] (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) (logid:97976fdd) ClusterScopeStoragePoolAllocator is returning [0] suitable storage pools [[]]. 2024-02-27 11:24:04,891 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator] (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) (logid:97976fdd) ZoneWideStoragePoolAllocator is returning [0] suitable storage pools [[]]. 2024-02-27 11:24:04,891 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) (logid:97976fdd) No suitable pools found for volume: Vol[1182|name=ROOT-1133|vm=1133|ROOT] under cluster: 1 2024-02-27 11:24:04,891 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) (logid:97976fdd) No suitable pools found 2024-02-27 11:24:04,891 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) (logid:97976fdd) No suitable storagePools found under this Cluster: 1 2024-02-27 11:24:04,898 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) (logid:97976fdd) Could not find suitable Deployment Destination for this VM under any clusters, returning. 2024-02-27 11:24:04,900 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) (logid:97976fdd) Searching all possible resources under this Zone: 1 2024-02-27 11:24:04,903 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) (logid:97976fdd) Listing clusters in order of aggregate capacity, that have (at least one host with) enough CPU and RAM capacity under this Zone: 1 2024-02-27 11:24:04,910 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) (logid:97976fdd) Removing from the clusterId list these clusters from avoid set: [1] 2024-02-27 11:24:04,911 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) (logid:97976fdd) No clusters found after removing disabled clusters and clusters in avoid list, returning. Alexi
Storage in avoid set
Hello Team, We've encountered an issue with our cloudstack setup on 3 XCP-ng hosts. Suddenly, VM deployments are failing. Our configuration includes a primary storage of type 'presetup' using HBA. Interestingly, the storage functions properly in the XEN cluster, allowing us to deploy VMs directly in xen. However, in cloudstack, deployments are failing with the following logs: "StoragePool is in avoid set, skipping this pool." Could someone please provide guidance on why it's in the avoid set and how we can remove it from there? Full logs are provided below for reference. 024-02-27 11:24:04,879 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) (logid:97976fdd) Looking for pools in dc [1], pod [1] and cluster [1]. Disabled pools will be ignored. 2024-02-27 11:24:04,881 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) (logid:97976fdd) Found pools [[Pool[1|PreSetup]]] that match with tags [[]]. 2024-02-27 11:24:04,885 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator] (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx -02929e21) (logid:97976fdd) Checking if storage pool is suitable, name: CLOUDSTACKVOL1 ,poolId: 1 2024-02-27 11:24:04,885 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator] (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) (logid:97976fdd) StoragePool is in avoid set, skipping this pool 2024-02-27 11:24:04,885 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator] (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) (logid:97976fdd) ClusterScopeStoragePoolAllocator is returning [0] suitable storage pools [[]]. 2024-02-27 11:24:04,891 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator] (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) (logid:97976fdd) ZoneWideStoragePoolAllocator is returning [0] suitable storage pools [[]]. 2024-02-27 11:24:04,891 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) (logid:97976fdd) No suitable pools found for volume: Vol[1182|name=ROOT-1133|vm=1133|ROOT] under cluster: 1 2024-02-27 11:24:04,891 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) (logid:97976fdd) No suitable pools found 2024-02-27 11:24:04,891 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) (logid:97976fdd) No suitable storagePools found under this Cluster: 1 2024-02-27 11:24:04,898 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) (logid:97976fdd) Could not find suitable Deployment Destination for this VM under any clusters, returning. 2024-02-27 11:24:04,900 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) (logid:97976fdd) Searching all possible resources under this Zone: 1 2024-02-27 11:24:04,903 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) (logid:97976fdd) Listing clusters in order of aggregate capacity, that have (at least one host with) enough CPU and RAM capacity under this Zone: 1 2024-02-27 11:24:04,910 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) (logid:97976fdd) Removing from the clusterId list these clusters from avoid set: [1] 2024-02-27 11:24:04,911 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-1:ctx-5ab127f5 job-12670/job-12671 ctx-02929e21) (logid:97976fdd) No clusters found after removing disabled clusters and clusters in avoid list, returning. Alexi
Re: CKS Storage Provisioner Info
Hi Wei, I am using shared network in the cluster with untagged as my network is isolated and it is provided by bridge internally. Please suggest can i do through network offering! Thanks and Regards, Bharat Saini [signature_3569743506] From: Wei ZHOU Date: Wednesday, 28 February 2024 at 4:40 PM To: users@cloudstack.apache.org Subject: Re: CKS Storage Provisioner Info EXTERNAL EMAIL: Please verify the sender email address before taking any action, replying, clicking any link or opening any attachment. Hi, Are you using a Shared network ? If yes, it will not work -Wei On Wed, Feb 28, 2024 at 11:17 AM Bharat Bhushan Saini wrote: > Hi Wei, > > > > Just to inform you that I am able to ping management ip from a pod which I > deployed for testing. > > Please refer below logs > > > > ping 10.x.xx.101 > > PING 10.x.xx.101 (10.x.xx.101) 56(84) bytes of data. > > 64 bytes from 10.x.xx.101: icmp_seq=1 ttl=63 time=0.430 ms > > 64 bytes from 10.x.xx.101: icmp_seq=2 ttl=63 time=0.420 ms > > ^C > > --- 10.x.xx.101 ping statistics --- > > 2 packets transmitted, 2 received, 0% packet loss, time 1014ms > > rtt min/avg/max/mdev = 0.420/0.425/0.430/0.005 ms > > > > Also I done some more changes now the error was some different. Please > have a look below > > > > Error syncing load balancer: failed to ensure load balancer: error > associating new IP address: CloudStack API error 431 (CSExceptionErrorCode: > 4350): Associate IP address can only be called on the shared networks in > the advanced zone with Firewall/Source Nat/Static Nat/Port Forwarding/Load > balancing services enabled > > > > @Jayanth,@Vivek, please have a look on that. > > > > Thanks and Regards, > > Bharat Saini > > > > [image: signature_1434537425] > > > > *From: *Wei ZHOU > *Date: *Wednesday, 28 February 2024 at 1:21 PM > *To: *users@cloudstack.apache.org > *Subject: *Re: CKS Storage Provisioner Info > > EXTERNAL EMAIL: Please verify the sender email address before taking any > action, replying, clicking any link or opening any attachment. > > > Hi, > > The CloudStack management server must be accessible from the pod > "cloud-controller-manager" in the CKS cluster. > > It looks like the issue is caused by your network configuration, not > CloudStack. > > -Wei > > On Wed, Feb 28, 2024 at 7:19 AM Bharat Bhushan Saini > wrote: > > > Hi Kiran, > > > > > > > > I used a private ip range which is bridged in my internal organisation > > network. > > > > > > > > JUST FYI, I also tested a simple deployment but it is also didn’t took > > external ip. > > > > > > > > > > > > Thanks and Regards, > > > > Bharat Saini > > > > > > > > --- Disclaimer: -- > This message and its contents are intended solely for the designated > addressee and are proprietary to Kloudspot. The information in this email > is meant exclusively for Kloudspot business use. Any use by individuals > other than the addressee constitutes misuse and an infringement of > Kloudspot's proprietary rights. If you are not the intended recipient, > please return this email to the sender. Kloudspot cannot guarantee the > security or error-free transmission of e-mail communications. Information > could be intercepted, corrupted, lost, destroyed, arrive late or > incomplete, or contain viruses. Therefore, Kloudspot shall not be liable > for any issues arising from the transmission of this email. > --- Disclaimer: -- This message and its contents are intended solely for the designated addressee and are proprietary to Kloudspot. The information in this email is meant exclusively for Kloudspot business use. Any use by individuals other than the addressee constitutes misuse and an infringement of Kloudspot's proprietary rights. If you are not the intended recipient, please return this email to the sender. Kloudspot cannot guarantee the security or error-free transmission of e-mail communications. Information could be intercepted, corrupted, lost, destroyed, arrive late or incomplete, or contain viruses. Therefore, Kloudspot shall not be liable for any issues arising from the transmission of this email.
Re: CKS Storage Provisioner Info
Hi, Are you using a Shared network ? If yes, it will not work -Wei On Wed, Feb 28, 2024 at 11:17 AM Bharat Bhushan Saini wrote: > Hi Wei, > > > > Just to inform you that I am able to ping management ip from a pod which I > deployed for testing. > > Please refer below logs > > > > ping 10.x.xx.101 > > PING 10.x.xx.101 (10.x.xx.101) 56(84) bytes of data. > > 64 bytes from 10.x.xx.101: icmp_seq=1 ttl=63 time=0.430 ms > > 64 bytes from 10.x.xx.101: icmp_seq=2 ttl=63 time=0.420 ms > > ^C > > --- 10.x.xx.101 ping statistics --- > > 2 packets transmitted, 2 received, 0% packet loss, time 1014ms > > rtt min/avg/max/mdev = 0.420/0.425/0.430/0.005 ms > > > > Also I done some more changes now the error was some different. Please > have a look below > > > > Error syncing load balancer: failed to ensure load balancer: error > associating new IP address: CloudStack API error 431 (CSExceptionErrorCode: > 4350): Associate IP address can only be called on the shared networks in > the advanced zone with Firewall/Source Nat/Static Nat/Port Forwarding/Load > balancing services enabled > > > > @Jayanth,@Vivek, please have a look on that. > > > > Thanks and Regards, > > Bharat Saini > > > > [image: signature_1434537425] > > > > *From: *Wei ZHOU > *Date: *Wednesday, 28 February 2024 at 1:21 PM > *To: *users@cloudstack.apache.org > *Subject: *Re: CKS Storage Provisioner Info > > EXTERNAL EMAIL: Please verify the sender email address before taking any > action, replying, clicking any link or opening any attachment. > > > Hi, > > The CloudStack management server must be accessible from the pod > "cloud-controller-manager" in the CKS cluster. > > It looks like the issue is caused by your network configuration, not > CloudStack. > > -Wei > > On Wed, Feb 28, 2024 at 7:19 AM Bharat Bhushan Saini > wrote: > > > Hi Kiran, > > > > > > > > I used a private ip range which is bridged in my internal organisation > > network. > > > > > > > > JUST FYI, I also tested a simple deployment but it is also didn’t took > > external ip. > > > > > > > > > > > > Thanks and Regards, > > > > Bharat Saini > > > > > > > > --- Disclaimer: -- > This message and its contents are intended solely for the designated > addressee and are proprietary to Kloudspot. The information in this email > is meant exclusively for Kloudspot business use. Any use by individuals > other than the addressee constitutes misuse and an infringement of > Kloudspot's proprietary rights. If you are not the intended recipient, > please return this email to the sender. Kloudspot cannot guarantee the > security or error-free transmission of e-mail communications. Information > could be intercepted, corrupted, lost, destroyed, arrive late or > incomplete, or contain viruses. Therefore, Kloudspot shall not be liable > for any issues arising from the transmission of this email. >
Re: CKS Storage Provisioner Info
Hi Wei, Just to inform you that I am able to ping management ip from a pod which I deployed for testing. Please refer below logs ping 10.x.xx.101 PING 10.x.xx.101 (10.x.xx.101) 56(84) bytes of data. 64 bytes from 10.x.xx.101: icmp_seq=1 ttl=63 time=0.430 ms 64 bytes from 10.x.xx.101: icmp_seq=2 ttl=63 time=0.420 ms ^C --- 10.x.xx.101 ping statistics --- 2 packets transmitted, 2 received, 0% packet loss, time 1014ms rtt min/avg/max/mdev = 0.420/0.425/0.430/0.005 ms Also I done some more changes now the error was some different. Please have a look below Error syncing load balancer: failed to ensure load balancer: error associating new IP address: CloudStack API error 431 (CSExceptionErrorCode: 4350): Associate IP address can only be called on the shared networks in the advanced zone with Firewall/Source Nat/Static Nat/Port Forwarding/Load balancing services enabled @Jayanth,@Vivek, please have a look on that. Thanks and Regards, Bharat Saini [signature_1434537425] From: Wei ZHOU Date: Wednesday, 28 February 2024 at 1:21 PM To: users@cloudstack.apache.org Subject: Re: CKS Storage Provisioner Info EXTERNAL EMAIL: Please verify the sender email address before taking any action, replying, clicking any link or opening any attachment. Hi, The CloudStack management server must be accessible from the pod "cloud-controller-manager" in the CKS cluster. It looks like the issue is caused by your network configuration, not CloudStack. -Wei On Wed, Feb 28, 2024 at 7:19 AM Bharat Bhushan Saini wrote: > Hi Kiran, > > > > I used a private ip range which is bridged in my internal organisation > network. > > > > JUST FYI, I also tested a simple deployment but it is also didn’t took > external ip. > > > > > > Thanks and Regards, > > Bharat Saini > > > --- Disclaimer: -- This message and its contents are intended solely for the designated addressee and are proprietary to Kloudspot. The information in this email is meant exclusively for Kloudspot business use. Any use by individuals other than the addressee constitutes misuse and an infringement of Kloudspot's proprietary rights. If you are not the intended recipient, please return this email to the sender. Kloudspot cannot guarantee the security or error-free transmission of e-mail communications. Information could be intercepted, corrupted, lost, destroyed, arrive late or incomplete, or contain viruses. Therefore, Kloudspot shall not be liable for any issues arising from the transmission of this email.
AW: delete old SystemVM Templates
Thx again, Wei! -Ursprüngliche Nachricht- Von: Wei ZHOU Gesendet: Dienstag, 27. Februar 2024 20:39 An: users@cloudstack.apache.org Betreff: Re: delete old SystemVM Templates No, you are free to remove any template which is not used any more. for SYSTEM templates, there is a check to guard the templates to be removed by mistake. so you need to change the type to USER then remove it. -Wei On Tue, Feb 27, 2024 at 5:04 PM wrote: > Thx! Is there any reason to keep old templates when no instance is > using it anymore? > > -Ursprüngliche Nachricht- > Von: Wei ZHOU > Gesendet: Dienstag, 27. Februar 2024 16:58 > An: users@cloudstack.apache.org > Betreff: Re: delete old SystemVM Templates > > if it is not needed, of course you can remove it > - update template type to USER > - delete the template from zones > > > -Wei > > On Tue, Feb 27, 2024 at 4:56 PM wrote: > > > Hello, > > > > is it possible to delete old, not used anymore, SystemVM Templates > > via > UI? > > And does it make sense to delete them? > > > > After upgrading from 4.18.1.0 to 4.19.0.0 we do have 2 systemvm > > templates registered (as expected) in our CS. The first one is > > called "SystemVM Template (KVM)" and the other one is called > "systemvm-kvm-4.19.0". > > > > router.template.kvm points to the new systemvm-kvm-4.19.0 one. > > SystemVM Template (KVM) is not being used by any instance and/or > > router. When I try to delete it via UI, I get: "Error The DomR > > template cannot be deleted." I did not try to force it. > > > > Should you cleaup your templates or do you just leave it there? > > > > > > > > Regards, > > > > Swen > > > > > > >
