RE: ACS with vmware hypervisors

Hi Jithin We are using ACS 4.15.2 and vsphere esxi v7.0.3 This is the log output for job-42701: 2023-07-07 14:10:48,968 INFO [o.a.c.f.j.i.AsyncJobMonitor] (API-Job-Executor-13:ctx-36699a50 job-42701) (logid:717a5506) Add job-42701 into job monitoring 2023-07-07 14:10:49,189 INFO [o.a.c.a.c.u

Re: ACS with vmware hypervisors

Hi Gary, I am unable to tell the cause of the VM deployment failures with the log snippets below. Could you try adding the storage as a datastore in vCenter and add it to CloudStack as ‘presetup’ ? -Jithin From: Gary Dixon Date: Monday, 10 July 2023 at 2:12 PM To: users@cloudstack.apache.org

RE: ACS with vmware hypervisors

Hi Jithin This is the odd thing - when we try and add the vcenter datastore to ACS as Primary storage - we do not have the 'preSetup' protocol option in the "add primary storage" UI ? Gary Dixon Senior Technical Consultant T: +44 161 537 4990 E: v...@quadris-support.com W: www.quadris.co.uk

Re: Write Speeds

Hi Guys Thank you, I have been running more tests now with the feedback you guys gave. Firstly, I want to break this up into two sections: 1. Network: - So I have been running iperf tests between my VMs on their public network, and my iperf tests gives me speeds of ~500 Mbps, keep in mind t

Async backup

Hi All, Can somebody explain what the "Async backup" option does while taking volume snapshot? Regards, Nikolaos

Re: Async backup

In short and in layman's terms, it makes the volume snapshot, stores it locally and then in the background transfers it to the storage location. This helps with server resource usage. But see attached screenshot for a detailed answer. On 7/10/23 12:38, Nikolaos Tsinganos wrote: Hi All, Can s

RE: Async backup

Thank you, Granwille for your prompt answer. Can you elaborate on the "locally" and "storage location" terms? On a host that has multiple primary storages (e.g. NFS and some other storage over iSCSI) but no local disks are used, what is considered as 'locally'? Also, by "storage location" do y

Re: Async backup

Correct me if I am wrong, all snapshots make a local copy to the management server disk before sending it to the secondary storage locations, yes. Async or not. But yes, I believe that is the case. However, when async is enabled you get to use and work on other tasks with the management server,

RE: Async backup

Hi Granwille, Thanks for clarifying this! Regards, Nikolaos From: Granwille Strauss Sent: Monday, July 10, 2023 2:21 PM To: users@cloudstack.apache.org Cc: Nikolaos Tsinganos Subject: Re: Async backup Correct me if I am wrong, all snapshots make a local copy to the

Re: Write Speeds

Hi Granwille! About the READ/WRITE performance, as Levin suggested, check the XML of virtual machines looking at disk/device section. Look for io='io_uring'. As stated here: https://github.com/apache/cloudstack/issues/4883 CloudStack can use io_uring with Qemu >= 5.0 and Libvirt >= 6.3.0. I tri

Re: Write Speeds

Hi Groete, I’m not sure what is your network setting in ACS, but test between two public IP with ~500Mbps  sound like u are saturated by in/out bound traffics in the single network path, can you do a test from outside ACS to your VM using an same public network segment IP, it will avoid network

Re: Write Speeds

Hi Jorge Thank you so much for this. I used your FIO config and surprisingly it seems fine: write-test: (g=0): rw=randrw, bs=(R) 1300MiB-1300MiB, (W) 1300MiB-1300MiB, (T) 1300MiB-1300MiB, ioengine=libaio, iodepth=1 fio-3.19 Run status group 0 (all jobs):    READ: bw=962MiB/s (1009MB/s), 962

Re: Write Speeds

Hi Levin I skipped all the VM testing and tested iperf straight from the KVM host to determine a base line to the remote USA VM machine: - KVM to Remote USA VM: 113 Mbits/sec - USA VM to KVM Host: 35.9 Mbits/sec I then ran the same test again, this this time the remote host was in a DC that'

Re: Write Speeds

Hi JorgeHow do you actually enable io_uring via Cloustack?My KVM does have the necessary requirements.I enabled io.policy settings in global settings, local storageand in the VM settings via UI. And my xml dump of VM doesn’t include io_uring under driver for some reason.-- Regards / GroeteGranwille

Re: ACS with vmware hypervisors

Did you choose right zone/pod/cluster, because I am also using 4.15.2 and it’s giving me option PreSetup, do you have option called - vmfs ? Vivek Kumar Sr. Manager - Cloud & DevOps TechOps | Indiqus Technologies vivek.ku...@indiqus.com www.indiqus.com

Re: Write Speeds

Did you check on network QoS on VR as well if there is any .! Vivek Kumar Sr. Manager - Cloud & DevOps TechOps | Indiqus Technologies vivek.ku...@indiqus.com www.indiqus.com > On 10-Jul-2023, at 9:34 PM, Granwille Strauss

Re: Write Speeds

Granwille, no special configuration, just the CloudStack default behavior. As I understand, CloudStack can detect automatically if host supports this feature based on qemu and libvirt versions. https://github.com/apache/cloudstack/issues/4883#issuecomment-813955599 What versions of kernel, qemu a

Re: Write Speeds

Vivek, yes I have and its in line with my VMs:                 On 7/10/23 18:50, Vivek Kumar wrote: Did you check on network QoS on VR as well if there is any .! Vivek Kumar Sr. Manager - Cloud & DevOps TechOps | Indiqus Technologies

RE: Async backup

> all snapshots make a local copy to the management server disk before sending > it to the secondary storage locations, yes. What exactly do you mean by that? From: Granwille Strauss Sent: Monday, July 10, 2023 1:21 PM To: users@cloudstack.apache.org Cc: Nikolaos Tsinganos Subject: Re: Async b

RE: Write Speeds

I doesn’t necessarily get throttled, the added latency will definitely impact the maximum bandwidth achievable per stream, especially if you are using TCP. In this case a bandwidth delay calculator can help you find the maximum theoretical bandwidth for a given latency: https://www.switch.ch/net

Re: Write Speeds

Anyone with any ideas why ACS is not detecting I have newer versions of qemu and libvirt to enable io_uring? On 7/10/23 19:57, Jorge Luiz Correa wrote: Hum, so strange. I'm not a CloudStack specialist but it look like the code is simple and try to test the versions of qemu and libvirt: http