VM Settings
Hi, I use cloudstack with KVM and I'm trying to add new information to the XML file of one of my VM's, to be more precise I want to add a new disk to it without using the Storage function. What I tried so far was using the VM Settings and extraconfig to pass on a URL with the configuration of my disk (which is actually a LUN) but I'm not sure how that works and the Documentation did help me much. So as a simpler question I want to know how I can add new stuff to a VM's XML file through Cloudstack. I added a value to allow.additional.vm.configuration.list.kvm and used this value ("disk" in this case) as my name when creating a new Setting in the VM and then put "extraconfig=myURL" in the value for the VM Setting. Is this right? I'm not sure what I should put as value in this Global Setting and not sure if it matters what I put as name in the VM Settings. If you could explain to me how that works or if there's better documentation or a video tutorial on VM Settings cause the official one did not help me. Thank you!! -- Victor Racy Analista de Infraestrutura +55 (11) 3842-8636 victor.r...@aodigital.com.br www.aodigital.com.br AVISO LEGAL Esta mensagem é destinada exclusivamente para a(s) pessoa(s) a quem é dirigida, podendo conter informação confidencial e/ou legalmente privilegiada. Se você não for destinatário desta mensagem, desde já fica notificado de abster-se a divulgar, copiar, distribuir, examinar ou, de qualquer forma, utilizar a informação contida nesta mensagem, por ser ilegal. Caso você tenha recebido esta mensagem por engano, pedimos que nos retorne este E-Mail, promovendo, desde logo, a eliminação do seu conteúdo em sua base de dados, registros ou sistema de controle. DISCLAIMER This message is exclusively destined to the person(s) to whom it is addressed, and it may contain confidential and/or legally privileged information. If this message is not addressed to you, you are notified from now on to not disclose, copy, distribute, examine or, in any other way, use the information contained in this message, considering that such action is illegal. In case you received this message due to an error, we beg you to return this e-mail, immediately promoting the elimination of its content from your database, records or control system.
Re: Problems with KVM HA & STONITH
Hello Boris, I am able to create VM with nfs+Ha and nfs without HA. The issue is with creating VM with Ceph storage. Regards Victor On 04/05/2018 01:18 PM, Boris Stoyanov wrote: Hi Victor, Host HA is working only with KVM + NFS. Ceph is not supported at this stage. Obviously RAW volumes are not supported on your pool, but I’m not sure if that’s because of Ceph or HA in general. Are you able to deploy a non-ha VM? Boris Stoyanov boris.stoya...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue On 5 Apr 2018, at 4:19, victor <vic...@ihnetworks.com> wrote: Hello Rohit, Is the Host HA provider start working with Ceph. The reason I am asking is because, I am not able to create a VM with Ceph storage in a kvm host with HA enabled and I am getting the following error while creating VM. .cloud.exception.StorageUnavailableException: Resource [StoragePool:2] is unreachable: Unable to create Vol[9|vm=6|DATADISK]:com.cloud.utils.exception.CloudRuntimeException: org.libvirt.LibvirtException: unsupported configuration: only RAW volumes are supported by this storage pool Regards Victor On 11/04/2017 09:53 PM, Rohit Yadav wrote: Hi James, (/cc Simon and others), A new feature exists in upcoming ACS 4.11, Host HA: https://cwiki.apache.org/confluence/display/CLOUDSTACK/Host+HA You can read more about it here as well: http://www.shapeblue.com/host-ha-for-kvm-hosts-in-cloudstack/ This feature can use a custom HA provider, with default HA provider implemented for KVM and NFS, and uses ipmi based fencing (STONITH) of the host. The current HA mechanism provides no such method of fencing (powering off) a host and it depends under what circumstances the VM HA is failing (environment issues, ACS version etc). As Simon mentioned, we have a (host) HA provider that works with Ceph in near future. Regards. From: Simon Weller <swel...@ena.com.INVALID> Sent: Thursday, November 2, 2017 7:27:22 PM To: users@cloudstack.apache.org Subject: Re: Problems with KVM HA & STONITH James, Ceph is a great solution and we run all of our ACS storage on Ceph. Note that it adds another layer of complexity to your installation, so you're going need to develop some expertise with that platform to get comfortable with how it works. Typically you don't want to mix Ceph with your ACS hosts. We in fact deploy 3 separate Ceph Monitors, and then scale OSDs as required on a per cluster basis in order to add additional resiliency (So every KVM ACS cluster has it's own Ceph "POD"). We also use Ceph for S3 storage (on completely separate Ceph clusters) for some other services. NFS is much simpler to maintain for smaller installations in my opinion. If the IO load you're looking at isn't going to be insanely high, you could look at building a 2 node NFS cluster using pacemaker and DRDB for data replication between nodes. That would reduce your storage requirement to 2 fairly low power servers (NFS is not very cpu intensive). Currently on a host failure when using a storage other than NFS on KVM, you will not see HA occur until you take the failed host out of the ACS cluster. This is a historical limitation because ACS could not confirm the host had been fenced correctly, so to avoid potential data corruption (due to 2 hosts mounting the same storage), it doesn't do anything until the operator intervenes. As of ACS 4.10, IPMI based fencing is now supported on NFS and we're planning on developing similar support for Ceph. Since you're an school district, I'm more than happy to jump on the phone with you to talk you through these options if you'd like. - Si From: McClune, James <mcclu...@norwalktruckers.net> Sent: Thursday, November 2, 2017 8:28 AM To: users@cloudstack.apache.org Subject: Re: Problems with KVM HA & STONITH Hi Simon, Thanks for getting back to me. I created one single NFS share and added it as primary storage. I think I better understand how the storage works, with ACS. I was able to get HA working with one NFS storage, which is good. However, is there a way to incorporate multiple NFS storage pools and still have the HA functionality? I think something like GlusterFS or Ceph (like Ivan and Dag described) will work better. Thank you Simon, Ivan, and Dag for your assistance! James On Wed, Nov 1, 2017 at 10:10 AM, Simon Weller <swel...@ena.com.invalid> wrote: James, Try just configuring a single NFS server and see if your setup works. If you have 3 NFS shares, across all 3 hosts, i'm wondering whether ACS is picking the one you rebooted as the storage for your VMs and when that storage goes away (when you bounce the host), all storage for your VMs vanishes and ACS tries to reboot your other hosts. Normally in a simple ACS setup, you would have a separate storage server that can serve up N
Re: Problems with KVM HA & STONITH
Hello Rohit, Is the Host HA provider start working with Ceph. The reason I am asking is because, I am not able to create a VM with Ceph storage in a kvm host with HA enabled and I am getting the following error while creating VM. .cloud.exception.StorageUnavailableException: Resource [StoragePool:2] is unreachable: Unable to create Vol[9|vm=6|DATADISK]:com.cloud.utils.exception.CloudRuntimeException: org.libvirt.LibvirtException: unsupported configuration: only RAW volumes are supported by this storage pool Regards Victor On 11/04/2017 09:53 PM, Rohit Yadav wrote: Hi James, (/cc Simon and others), A new feature exists in upcoming ACS 4.11, Host HA: https://cwiki.apache.org/confluence/display/CLOUDSTACK/Host+HA You can read more about it here as well: http://www.shapeblue.com/host-ha-for-kvm-hosts-in-cloudstack/ This feature can use a custom HA provider, with default HA provider implemented for KVM and NFS, and uses ipmi based fencing (STONITH) of the host. The current HA mechanism provides no such method of fencing (powering off) a host and it depends under what circumstances the VM HA is failing (environment issues, ACS version etc). As Simon mentioned, we have a (host) HA provider that works with Ceph in near future. Regards. From: Simon Weller <swel...@ena.com.INVALID> Sent: Thursday, November 2, 2017 7:27:22 PM To: users@cloudstack.apache.org Subject: Re: Problems with KVM HA & STONITH James, Ceph is a great solution and we run all of our ACS storage on Ceph. Note that it adds another layer of complexity to your installation, so you're going need to develop some expertise with that platform to get comfortable with how it works. Typically you don't want to mix Ceph with your ACS hosts. We in fact deploy 3 separate Ceph Monitors, and then scale OSDs as required on a per cluster basis in order to add additional resiliency (So every KVM ACS cluster has it's own Ceph "POD"). We also use Ceph for S3 storage (on completely separate Ceph clusters) for some other services. NFS is much simpler to maintain for smaller installations in my opinion. If the IO load you're looking at isn't going to be insanely high, you could look at building a 2 node NFS cluster using pacemaker and DRDB for data replication between nodes. That would reduce your storage requirement to 2 fairly low power servers (NFS is not very cpu intensive). Currently on a host failure when using a storage other than NFS on KVM, you will not see HA occur until you take the failed host out of the ACS cluster. This is a historical limitation because ACS could not confirm the host had been fenced correctly, so to avoid potential data corruption (due to 2 hosts mounting the same storage), it doesn't do anything until the operator intervenes. As of ACS 4.10, IPMI based fencing is now supported on NFS and we're planning on developing similar support for Ceph. Since you're an school district, I'm more than happy to jump on the phone with you to talk you through these options if you'd like. - Si From: McClune, James <mcclu...@norwalktruckers.net> Sent: Thursday, November 2, 2017 8:28 AM To: users@cloudstack.apache.org Subject: Re: Problems with KVM HA & STONITH Hi Simon, Thanks for getting back to me. I created one single NFS share and added it as primary storage. I think I better understand how the storage works, with ACS. I was able to get HA working with one NFS storage, which is good. However, is there a way to incorporate multiple NFS storage pools and still have the HA functionality? I think something like GlusterFS or Ceph (like Ivan and Dag described) will work better. Thank you Simon, Ivan, and Dag for your assistance! James On Wed, Nov 1, 2017 at 10:10 AM, Simon Weller <swel...@ena.com.invalid> wrote: James, Try just configuring a single NFS server and see if your setup works. If you have 3 NFS shares, across all 3 hosts, i'm wondering whether ACS is picking the one you rebooted as the storage for your VMs and when that storage goes away (when you bounce the host), all storage for your VMs vanishes and ACS tries to reboot your other hosts. Normally in a simple ACS setup, you would have a separate storage server that can serve up NFS to all hosts. If a host dies, then a VM would be brought up on a spare hosts since all hosts have access to the same storage. Your other option is to use local storage, but that won't provide HA. - Si From: McClune, James <mcclu...@norwalktruckers.net> Sent: Monday, October 30, 2017 2:26 PM To: users@cloudstack.apache.org Subject: Re: Problems with KVM HA & STONITH Hi Dag, Thank you for responding back. I am currently running ACS 4.9 on an Ubuntu 14.04 VM. I have the three nodes, each having about 1TB of primary storage (NFS) and 1TB of secondary storage (NFS). I added each
Re: KVM HostHA
Hello Guys, I think it is related == https://github.com/apache/cloudstack/pull/2474 === On 03/14/2018 02:05 PM, Jon Marshall wrote: Hi Paul My testing does indeed end up with the failed host in maintenance mode but the VMs are never migrated. As I posted earlier the management server seems to be saying there is no other host that the VM can be migrated to. Couple of questions if you have the time to respond - 1) this article seems to suggest a reboot or powering off a host will end result in the VMs being migrated and this was on CS v 4.2.1 back in 2013 so does Host HA do something different 2) Whenever one of my two nodes is taken down in testing the active compute nodes HA status goes from Available to Ineligible. Should this happen ie. is it going to Ineligible stopping the manager from migrating the VMs. Apologies for all the questions but I just can't get this to work at the moment. If I do eventually get it working I will do a write up for others with same issue :) From: Paul Angus <paul.an...@shapeblue.com> Sent: 14 March 2018 07:45 To: users@cloudstack.apache.org Subject: RE: KVM HostHA Hi Parth, Two answer your questions, VM-HA does not restart VMs on an alternate host if the original host goes down. The management server (without host-HA) cannot tell what happened to the host. It cannot tell if there was a failure in the agent, loss of connectivity to the management NIC or if the host is truly down. In the first two scenarios, the guest VMs can still be running perfectly well, and to restart them elsewhere would be very dangerous. Therefore, the correct thing to do is - nothing but alert the operator. These scenarios are what Host-HA was introduced for. Wrt to STONITH, if no disk activity is detected on the host, host-HA will try to restart (via IPMI) the host. If, after a configurable number of attempts, the host agent still does not check in, then host-HA will shut down the host (via IPMA), trigger VM-HA and mark the host as in-maintenance. paul.an...@shapeblue.com www.shapeblue.com<http://www.shapeblue.com> [http://www.shapeblue.com/wp-content/uploads/2017/06/logo.png]<http://www.shapeblue.com/> Shapeblue - The CloudStack Company<http://www.shapeblue.com/> www.shapeblue.com Rapid deployment framework for Apache CloudStack IaaS Clouds. CSForge is a framework developed by ShapeBlue to deliver the rapid deployment of a standardised ... 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Parth Patel <parthpatel2...@gmail.com> Sent: 14 March 2018 05:05 To: users@cloudstack.apache.org Subject: Re: KVM HostHA Hi Paul, Thanks for the clarification. I currently don't have an ipmi enabled hardware (in test environment), but it will be beneficial if you can help me clear out some basic concepts of it: - If HA-enabled VMs are autostarted on another host when current host goes down, what is the need or purpose of HA-host? (other than management server able to remotely control it's power interfaces) - I understood the "Shoot-the-other-node-in-the-head" (STONITH) approach ACS uses to fence the host, but I couldn't find what mechanism or events trigger this? Thanks and regards, Parth Patel On Wed, 14 Mar 2018 at 02:22 Paul Angus <paul.an...@shapeblue.com> wrote: The management server doesn't ping the host through IPMI. However if IPMI is not available, you will not be able to use Host HA, as there is no way for CloudStack to 'fence' the host - that is shut it down to be sure that a VM cannot start again on that host. I can explain why that is necessary if you wish. Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com<http://www.shapeblue.com> [http://www.shapeblue.com/wp-content/uploads/2017/06/logo.png]<http://www.shapeblue.com/> Shapeblue - The CloudStack Company<http://www.shapeblue.com/> www.shapeblue.com Rapid deployment framework for Apache CloudStack IaaS Clouds. CSForge is a framework developed by ShapeBlue to deliver the rapid deployment of a standardised ... 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Parth Patel <parthpatel2...@gmail.com> Sent: 13 March 2018 16:57 To: users@cloudstack.apache.org Cc: Jon Marshall <jms@hotmail.co.uk> Subject: Re: KVM HostHA Hi Jon and Victor, I think the management server pings your host using ipmi (I really don't hope this is the case). In my case, I did not have OOBM enabled at all (my hardware didn't support it) I think you could disable OOBM and/or HA-Host and give that a try :) On Tue, 13 Mar 2018 at 20:40 victor <vic...@ihnetworks.com> wrote: Hello Guys, I have tried the following two cases. 1, "echo c > /proc/sysrq-trigger" 2, Pulled the network cable of one of the host In both cases, the following happened.
Re: KVM HostHA
Thanks for the response. I think I am not understanding how it was meant to work then. My understanding was that the manager used ipmitool to just keep querying the compute nodes as to their status so I assumed it didn't matter how you shut the node down, once it was down the manager would get no response and mark it as down (which it does). I am in testing mode so I think I will just go and pull the power and see what happens :) Thanks Jon From: Paul Angus <paul.an...@shapeblue.com> Sent: 12 March 2018 15:31 To: users@cloudstack.apache.org Subject: RE: KVM HostHA Hi Jon, I think that what you guys are finding, is that a controlled host shutdown, which will cause the agent to shutdown cleanly; Is not considered an HA event. I wouldn't expect CloudStack to take any action if you shut down a host, only if the host (agent) stops responding. Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com<http://www.shapeblue.com> [http://www.shapeblue.com/wp-content/uploads/2017/06/logo.png]<http://www.shapeblue.com/> Shapeblue - The CloudStack Company<http://www.shapeblue.com/> www.shapeblue.com Rapid deployment framework for Apache CloudStack IaaS Clouds. CSForge is a framework developed by ShapeBlue to deliver the rapid deployment of a standardised ... [http://www.shapeblue.com/wp-content/uploads/2017/06/logo.png [http://www.shapeblue.com/wp-content/uploads/2017/06/logo.png] ]< http://www.shapeblue.com/> [http://www.shapeblue.com/wp-content/uploads/2017/06/logo.png]<http://www.shapeblue.com/> Shapeblue - The CloudStack Company<http://www.shapeblue.com/> www.shapeblue.com Rapid deployment framework for Apache CloudStack IaaS Clouds. CSForge is a framework developed by ShapeBlue to deliver the rapid deployment of a standardised ... Shapeblue - The CloudStack Company<http://www.shapeblue.com/> [http://www.shapeblue.com/wp-content/uploads/2017/06/logo.png]<http://www.shapeblue.com/> Shapeblue - The CloudStack Company<http://www.shapeblue.com/> www.shapeblue.com Rapid deployment framework for Apache CloudStack IaaS Clouds. CSForge is a framework developed by ShapeBlue to deliver the rapid deployment of a standardised ... www.shapeblue.com<http://www.shapeblue.com> [http://www.shapeblue.com/wp-content/uploads/2017/06/logo.png]<http://www.shapeblue.com/> Shapeblue - The CloudStack Company<http://www.shapeblue.com/> www.shapeblue.com Rapid deployment framework for Apache CloudStack IaaS Clouds. CSForge is a framework developed by ShapeBlue to deliver the rapid deployment of a standardised ... Rapid deployment framework for Apache CloudStack IaaS Clouds. CSForge is a framework developed by ShapeBlue to deliver the rapid deployment of a standardised ... 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Jon Marshall <jms@hotmail.co.uk> Sent: 12 March 2018 15:15 To: users@cloudstack.apache.org Subject: Re: KVM HostHA I have the same issue here and am not entirely sure what the behaviour should be. I have one manager node and 2 compute nodes running 4.11 with ipmi working correctly. From the UI under HA - HA Enabled Yes HA State Available HA Provider kvmhaprovider although interestingly from the "Details" tab it shows - HA enabled No which I assume is a cosmetic issue ? On each compute node I have one HA enabled VM and one non HA enabled VM. I power off a compute node and the UI updates the host status and the VMs on that node stop responding but they never fail over to the other node. Couple of things I noticed - 1) as soon as i power off the compute node the HA state on the other node shows "Ineligible" 2) In the UI the instances all still show as green even though two of them are not available Any help much appreciated From: victor <vic...@ihnetworks.com> Sent: 07 March 2018 17:01 To: users@cloudstack.apache.org Subject: KVM HostHA Hello Guys, I have installed cloudstack 4.11. I have enabled HA for each hosts I have added. I have also added ipmi successfully (using ipmi driver). The hosts are showing like the following. === HA Enabled Yes HA State Available HA Provider kvmhaprovider == Also the host is showing the following correctly Resource state --> Enabled State --> UP Power state --> On So I have shutdown one of the hosts to see how the KVM hosts Ha is working. I have waited for half an hour. But nothing has happened. What will happen to the VM's in that host, if the host failed to back up. There isn't much from logs. Regards Victor
Re: KVM HostHA
Hell Paul, I am using the default values set by cloudstack and didn't changed those default values. Regards Victor On 03/07/2018 11:37 PM, Paul Angus wrote: Hi Victor, What parameters do you have for: kvm.ha.activity.check.max.attempts kvm.ha.activity.check.interval kvm.ha.activity.check.timeout kvm.ha.health.check.timeout kvm.ha.degraded.max.period the logs should show entries relating to these, BUT it's possible that as you performed a clean shutdown, the agent could have sent a shutdown ack to the management server, so the management server may no longer be polling. I'm not sure about that scenario. I recently used: echo c > /proc/sysrq-trigger as suggested by Nux, to simulate a host crash. paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: victor <vic...@ihnetworks.com> Sent: 07 March 2018 17:02 To: users@cloudstack.apache.org Subject: KVM HostHA Hello Guys, I have installed cloudstack 4.11. I have enabled HA for each hosts I have added. I have also added ipmi successfully (using ipmi driver). The hosts are showing like the following. === HA Enabled Yes HA StateAvailable HA Provider kvmhaprovider == Also the host is showing the following correctly Resource state --> Enabled State --> UP Power state --> On So I have shutdown one of the hosts to see how the KVM hosts Ha is working. I have waited for half an hour. But nothing has happened. What will happen to the VM's in that host, if the host failed to back up. There isn't much from logs. Regards Victor
Re: KVM HostHA
Hello Andrija, Yes I am doing the same test as you mentioned ie unplug NIC in one of the host and observer the action of VM's in that host. But in my test the VM's didn't get started in another host. Regards Victor On 03/07/2018 11:52 PM, Andrija Panic wrote: Hi Victor, zero experience here with 4.11 in general, but what are you expecting to happen ? you powered off a host, so nothing for IPMI driver to do - host is down already, no host HA actions are expected afaik. I guess you might have have wanted to i.e. unplug NIC (cause network issues on MGMT network), or... kill agent service and then observe the actions. Were VMs started on another host, in your test? Cheers On 7 March 2018 at 18:01, victor <vic...@ihnetworks.com> wrote: Hello Guys, I have installed cloudstack 4.11. I have enabled HA for each hosts I have added. I have also added ipmi successfully (using ipmi driver). The hosts are showing like the following. === HA Enabled Yes HA StateAvailable HA Provider kvmhaprovider == Also the host is showing the following correctly Resource state --> Enabled State --> UP Power state --> On So I have shutdown one of the hosts to see how the KVM hosts Ha is working. I have waited for half an hour. But nothing has happened. What will happen to the VM's in that host, if the host failed to back up. There isn't much from logs. Regards Victor
KVM HostHA
Hello Guys, I have installed cloudstack 4.11. I have enabled HA for each hosts I have added. I have also added ipmi successfully (using ipmi driver). The hosts are showing like the following. === HA Enabled Yes HA StateAvailable HA Provider kvmhaprovider == Also the host is showing the following correctly Resource state --> Enabled State --> UP Power state --> On So I have shutdown one of the hosts to see how the KVM hosts Ha is working. I have waited for half an hour. But nothing has happened. What will happen to the VM's in that host, if the host failed to back up. There isn't much from logs. Regards Victor
Re: Fields are blank while creating guest network
Hello Paul, This is a clean install of 4.11 and not an upgrade Regards Victor On 02/28/2018 01:15 PM, Paul Angus wrote: Hi Victor, For us to look, is this a clean install of 4.11 or an upgrade? paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: victor <vic...@ihnetworks.com> Sent: 27 February 2018 23:21 To: users@cloudstack.apache.org Subject: Fields are blank while creating guest network Hello Guys, I am using cloudstack version 4.11. While creating a guest network, I can see that the zone dropdown and network offering dropdown are all blank. Some bug has been reported related to this. Is it really a bug or any configuration issues. If it is really a bug, how can we fix it. Any thoughts Regards Victor
Fields are blank while creating guest network
Hello Guys, I am using cloudstack version 4.11. While creating a guest network, I can see that the zone dropdown and network offering dropdown are all blank. Some bug has been reported related to this. Is it really a bug or any configuration issues. If it is really a bug, how can we fix it. Any thoughts Regards Victor
Issue with storage while deploying VM
Hello Guys, I was using cloudstack for some tome. But today while creating VM', I got the following error from backend. === 2018-02-25 19:56:50,105 DEBUG [c.c.s.StorageManagerImpl] (API-Job-Executor-8:ctx-6b5aebd2 job-403 ctx-0358836c) (logid:0ec966c2) Checking pool 11 for storage, totalSize: 160982630400, usedBytes: 53763637248, usedPct: 0.333971665852467, disable threshold: 0.85 2018-02-25 19:56:50,105 DEBUG [c.c.s.StorageManagerImpl] (API-Job-Executor-8:ctx-6b5aebd2 job-403 ctx-0358836c) (logid:0ec966c2) Destination pool id: 11 2018-02-25 19:56:50,115 DEBUG [c.c.s.StorageManagerImpl] (API-Job-Executor-8:ctx-6b5aebd2 job-403 ctx-0358836c) (logid:0ec966c2) pool id for the volume with id: 83 is null 2018-02-25 19:56:50,115 DEBUG [c.c.s.StorageManagerImpl] (API-Job-Executor-8:ctx-6b5aebd2 job-403 ctx-0358836c) (logid:0ec966c2) Found storage pool Glus2 of type Gluster 2018-02-25 19:56:50,115 DEBUG [c.c.s.StorageManagerImpl] (API-Job-Executor-8:ctx-6b5aebd2 job-403 ctx-0358836c) (logid:0ec966c2) Total capacity of the pool Glus2 id: 11 is 160982630400 2018-02-25 19:56:50,116 DEBUG [c.c.s.StorageManagerImpl] (API-Job-Executor-8:ctx-6b5aebd2 job-403 ctx-0358836c) (logid:0ec966c2) Checking pool: 11 for volume allocation [Vol[83|vm=57|ROOT]], maxSize : 160982630400, totalAllocatedSize : 549755813888, askingSize : 0, allocated disable threshold: 10.0 2018-02-25 19:56:50,116 DEBUG [c.c.s.StorageManagerImpl] (API-Job-Executor-8:ctx-6b5aebd2 job-403 ctx-0358836c) (logid:0ec966c2) Insufficient un-allocated capacity on: 11 for volume allocation: [Vol[83|vm=57|ROOT]], not enough storage, maxSize : 160982630400, totalAllocatedSize : 549755813888, askingSize : 0 == I couldn't understand the meaning of this. I am glusterfs for storage and have enough space available, enough ram and ip. Can anybody shed some light regarding the above error. Especially with the part "maxSize : 160982630400, totalAllocatedSize : 549755813888, askingSize : 0" Regards Victor
Re: IPMI out of management
Hello Rohit, As mentioned in the following url, IPMI method will help to achieve HA with KVM hypervisor. https://cwiki.apache.org/confluence/display/CLOUDSTACK/KVM+HA+with+IPMI+Fencing = I have successfully implemented IPMI out of management with my 2 KVM hyper-visors successfully. But I couldn't find a way how we can achieve HA with the host. What will happen to the VM's in a host which is in halted state. Can you explain how the out of management help you in this case. I couldn't trace out much from the logs. Regards Victor On 08/07/2017 12:33 AM, Rohit Yadav wrote: Victor, Which proposed features do you want to know, if they are covered with ipmi oobm? As per current master, 4.10/4.9 releases, IPMI based out-of-band management works with CloudStack. - Rohit From: victor <vic...@ihnetworks.com> Sent: Thursday, August 3, 2017 6:44:26 AM To: users@cloudstack.apache.org; Rohit Yadav Subject: Re: IPMI out of management Hello Guys, I am also able to successfully configure ipmi fencing with cloudstack. Also can you guys let me know whether all the proposed features are fully covered with the ipmi out of management. Regards Victor On 08/03/2017 03:35 AM, Rohit Yadav wrote: Thanks Gabriel, Rodrigo -- good to know this is in use. Victor - yes it works, there is a ipmisim [1] tool you can test the implementation against, as well as real h/w. [1] https://pypi.python.org/pypi/ipmisim - Rohit From: Rodrigo Baldasso <rodr...@loophost.com.br> Sent: Tuesday, August 1, 2017 2:38:28 PM To: users@cloudstack.apache.org Subject: Re: IPMI out of management I'm using here and works fine with my Supermicro servers. - - - - - - - - - - - - - - - - - - - Rodrigo Baldasso - LHOST (51) 9 8419-9861 - - - - - - - - - - - - - - - - - - - On 01/08/2017 09:01:20, victor <vic...@ihnetworks.com> wrote: Hello Guys, Have anybody able to configure and test ipmi "out of management" with cloudstack successfully. Regards Victor rohit.ya...@shapeblue.com www.shapeblue.com<http://www.shapeblue.com> 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue rohit.ya...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue
Re: IPMI out of management
Hello Guys, I am also able to successfully configure ipmi fencing with cloudstack. Also can you guys let me know whether all the proposed features are fully covered with the ipmi out of management. Regards Victor On 08/03/2017 03:35 AM, Rohit Yadav wrote: Thanks Gabriel, Rodrigo -- good to know this is in use. Victor - yes it works, there is a ipmisim [1] tool you can test the implementation against, as well as real h/w. [1] https://pypi.python.org/pypi/ipmisim - Rohit From: Rodrigo Baldasso <rodr...@loophost.com.br> Sent: Tuesday, August 1, 2017 2:38:28 PM To: users@cloudstack.apache.org Subject: Re: IPMI out of management I'm using here and works fine with my Supermicro servers. - - - - - - - - - - - - - - - - - - - Rodrigo Baldasso - LHOST (51) 9 8419-9861 - - - - - - - - - - - - - - - - - - - On 01/08/2017 09:01:20, victor <vic...@ihnetworks.com> wrote: Hello Guys, Have anybody able to configure and test ipmi "out of management" with cloudstack successfully. Regards Victor rohit.ya...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue
IPMI out of management
Hello Guys, Have anybody able to configure and test ipmi "out of management" with cloudstack successfully. Regards Victor
KVM+HA
Hello Guys, I am facing the same issue that mentioned in the following url . - https://issues.apache.org/jira/browse/CLOUDSTACK-3535 - When the host is put in maintenance mode , then ha enabled VM's are automatically migrated to available host. But when the kvm host is down, no HA is done. The vm's are still down until I put the host node back up. I have tried everything like the following. = 1, system VM's and client vm's are created in shared storage 3, Added ha.tag host tags 2, Created host by adding ha tag 3, Created VE's in Ha enabled host with ha enabled service offering Do you guys have successfully tested Ha. I am really stuck at this part. Regards
Re: KVM hypervm and HA
Hello, Thanks for the update. When a single vm in "hypervm1" is stopped or down, it gets automatically started in the second vm. But when the entire hypervm1 server is down completely, the vm' inside it is not getting started in the secondary "hypervm2". Is the feature is version specific. Regards Victor On 07/12/2017 08:26 AM, Ivan Kudryavtsev wrote: Hi, Victor. They both will be moved automatically to a new host by ACS. 12 июл. 2017 г. 5:23 пользователь "victor" <vic...@ihnetworks.com> написал: Hello, I have a cloudstack system with one management server, one nfs server and two kvm hypervm host servers. Initially I configured cloudstack with hypervm1, so the system vm and console proxy gets created in it. Lately I have added hypervm2 and created few instances in it. So my doubt is the following. 1, If hypervm 1 is down which contain system-vm,console-proxy and router-vm, then what will happen. 2, If hypervm 1 is down completely and we couldn't make it up, will the system vm,console proxy and router vm will be switched to hypervm2 automatically. If it is not automatically, then is there any option for that. Regards Victor
KVM hypervm and HA
Hello, I have a cloudstack system with one management server, one nfs server and two kvm hypervm host servers. Initially I configured cloudstack with hypervm1, so the system vm and console proxy gets created in it. Lately I have added hypervm2 and created few instances in it. So my doubt is the following. 1, If hypervm 1 is down which contain system-vm,console-proxy and router-vm, then what will happen. 2, If hypervm 1 is down completely and we couldn't make it up, will the system vm,console proxy and router vm will be switched to hypervm2 automatically. If it is not automatically, then is there any option for that. Regards Victor