[ovirt-users] Re: ovirt-imagio-proxy upload speed slow
ovirt-engine-4.2.8.2-1.el7.noarch ovirt-imageio-proxy-1.4.6-1.el7.noarch ovirt-imageio-daemon-1.4.6-1.el7.noarch ___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/OTE6AWQLYPQKNF3YUD2NKNFHULRSBIDI/
[ovirt-users] Re: ovirt-imagio-proxy upload speed slow
Hello, We have the same problem. It's seems that the ovirt-imageio-proxy is the bottleneck for our setup. We use vprotect to backup a VM via api We ask for support with vprotect team and we are currently tunning some parameters on the kernel. We have full 10G network in ou setup. Here is the kernel parameter that we set. Did you manage to progress on the speed process ? # Maximum receive socket buffer size net.core.rmem_max = 134217728 # Maximum send socket buffer size net.core.wmem_max = 134217728 # Minimum, initial and max TCP Receive buffer size in Bytes net.ipv4.tcp_rmem = 4096 87380 134217728 # Minimum, initial and max buffer space allocated net.ipv4.tcp_wmem = 4096 65536 134217728 # Maximum number of packets queued on the input side net.core.netdev_max_backlog = 30 # Auto tuning net.ipv4.tcp_moderate_rcvbuf =1 # Don't cache ssthresh from previous connection net.ipv4.tcp_no_metrics_save = 1 # The Hamilton TCP (HighSpeed-TCP) algorithm is a packet loss based congestion control and is more aggressive pushing up to max bandwidth (total BDP) and favors hosts with lower TTL / VARTTL. net.ipv4.tcp_congestion_control=htcp # If you are using jumbo frames set this to avoid MTU black holes. net.ipv4.tcp_mtu_probing = 1 ___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/PKBHNHPFRZYQCYZRJMDNYGXPAXPYDIBS/
[ovirt-users] From Self-hosted engine to standalone engine
Hello, we currently have a self-hosted engine on gluster with 3 hosts. We want to have the engine on a single machine on a standalone KVM. We did the following steps on our test platform. - Create a VM on a standalone KVM - Put the self hosted engine into global maintenance - Shut the self-hosted engine - Copy the self-hosted engine image disk (by browsing into the gluster engine volume) by using linux dd command to the standalone KVM - Reusing the self-hosted engine's MAC address on the new standalone VM - Starting the standalone VM which use the self-hosted image disk previously copied on the standalone KVM - Log in the engine and then undeploy the hosted-engine by re-installing all the host and go for UNDEPLOY on the self-hosted section - Stop ovirt-ha-agent and ovirt-ha-broker Everything seems to be ok for now. What do you think about our process ? (to go from self-hosted to standalone) Do you have any idea on what should be checked ? Thank you (We wanted to go out from self-hosted engine, because we don't really master this deployment) ___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/5UZROLYIC273ARCXUIWHOIIVC3EPGS6E/
[ovirt-users] Re: Migrate datacenter with hosts and VM managed from engine no1 to engine no2
Hello Simone, at first, let me thank you for your answer. Ok for the storage domain. I have already done this before. The storage domain is a glusterfs domain. The glusterfs volume is composed of 3 hosts which are managed from the 1st engine. I wanted the detach the hosts, vm, storage domain from that engine and import everything on a new engine without loosing gluster volume info These are the steps I would like to do - stop all the VM - put into maintenance the storage domain - detach the storage domain from the datacenter - put all the host into maintenance - remove every host from the datacenter On the new engine: - create a new datacenter, cluster - add the host from the old datacenter (which does have glusterfs's conf) to the cluster - import the storage domain - import the VM from that storage domain Well I think I have to give a try on a test platform. Any advice about those steps ? ___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/QAFYDJA627IASRX3RT52JX7L5AE2NQK4/
[ovirt-users] Migrate datacenter with hosts and VM managed from engine no1 to engine no2
Hello, we have the current setup. => 1 datacenter on site A with 1 cluster which is compose of 3 hosts and a self-hosted engine => 1 datacenter on site B (let's call this TATA) with 1 cluster compose of 3 hosts which is using glusterfs. This datacenter is managed by the self-hosted engine on site A We want to create on site B another datacenter with 1 cluster and another self-hosted engine then disengage datacenter TATA from self-hosted engine on site A. after that, we want to import all the ressource on the self-hosted engine on site B Is it possible to do this without loosing VM on glusterfs ? Off course VM will be shutdown during the operation. I mean, when a host is added on a new datacenter, ovirt will install package if necessary. Is there any way that ovirt manager erase actual configuration ? Is it safe to do this operation ? ___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/7R3QTNLMP4MQNAUYLRNBTBJLKLHUAVFC/
[ovirt-users] Re: disk_vm_element ERROR: duplicate key value violates unique constraint "pk_disk_vm_element"
Hello Raz, after looking onto rhev documentation, I did find the "THE ENGINE VACUUM TOOL". It seems to "maintains PostgreSQL databases by updating tables and removing dead rows, allowing disk space to be reused" Maybe it will delete old entries ? ___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/J447KK7C4OBM5F4H3QA5K45HUY7WYW7N/
[ovirt-users] Re: Failed to hot-plug disk
Hello Raz, yes i saw this bug. But the problem doesn't seem to be the same. I search on google with qemu + write lock but didn't find anything. Do you know the command launch by this opération ? qemu-img ? ___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/2OUJ63JSQEZPWZ6X666TZQZQJ2DMGLXS/
[ovirt-users] Re: disk_vm_element ERROR: duplicate key value violates unique constraint "pk_disk_vm_element"
Hi Raz, yes i saw this bug. But I was focusing on the opération that leads to it which is not the same as me. I'm not very familiar with bugzilla. No solution for the moment for this bug ? ___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/P5LZI7QDTXKHJJC3CSQRQSJNM7YFWUPF/
[ovirt-users] disk_vm_element ERROR: duplicate key value violates unique constraint "pk_disk_vm_element"
Hello, when i tried to attach a snapshot disk into my backupvm. oVirt doesn't want to attach it. In the engine.log I can see this. 2018-08-04 19:20:04,472-10 ERROR [org.ovirt.engine.core.bll.storage.disk.AttachDiskToVmCommand] (default task-33) [646ad7a1-4501-4648-a937-bbee0abaec46] Command 'org.ovirt.engine.core.bll.storage.disk.AttachDiskToVmCommand' failed: CallableStatementCallback; SQL [{call insertdiskvmelement(?, ?, ?, ?, ?, ?)}]; ERROR: duplicate key value violates unique constraint "pk_disk_vm_element" Detail: Key (vm_id, disk_id)=(78ef239f-3cb3-4eef-921f-f989724009ef, c7cef731-e31d-4597-80f1-1f2393cd66ea) already exists. Where: SQL statement "INSERT INTO disk_vm_element ( disk_id, vm_id, is_boot, pass_discard, disk_interface, is_using_scsi_reservation) VALUES ( v_disk_id, v_vm_id, v_is_boot, v_pass_discard, v_disk_interface, v_is_using_scsi_reservation)" PL/pgSQL function insertdiskvmelement(uuid,uuid,boolean,boolean,character varying,boolean) line 3 at SQL statement; nested exception is org.postgresql.util.PSQLException: ERROR: duplicate key value violates unique constraint "pk_disk_vm_element" Detail: Key (vm_id, disk_id)=(78ef239f-3cb3-4eef-921f-f989724009ef, c7cef731-e31d-4597-80f1-1f2393cd66ea) already exists. When i SQL the database, the entries is present (and many other). But in the webinterface, I can't see them on the backupVM. It's just like ovirt didn't delete old entries engine=# select * from disk_vm_element where vm_id = '78ef239f-3cb3-4eef-921f-f989724009ef' and disk_id = 'c7cef731-e31d-4597-80f1-1f2393cd66ea' ; disk_id|vm_id | is_boot | disk_interface | is_using_scsi_reservation | pass_discard --+--+-++---+-- c7cef731-e31d-4597-80f1-1f2393cd66ea | 78ef239f-3cb3-4eef-921f-f989724009ef | f | VirtIO | f | f (1 row) Do you guys have any idea on how to correct this ? Is there any function to update / refresh this table ? I dont want to delete entries by sql as i don't know the consequences, is it safe to delete entries ? Thank you for your help ___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/PXGZ62TGLMO7PTBKVPSTZCEBRAW2L5QK/
[ovirt-users] Failed to hot-plug disk
Hello, I have a problem when i tried to hotplug a disk to a VM. Here is the situation. We use a VM (let's call this backupVM) which is responsible of doing our VM backup by : - Making a snapshot of the VM we want to backup - Attach the snapshot disk - Make the copy using DD - Unplug the snapshot disk and then delete snapshot. For some reason that i don't know, for certain VM, the backupVM cannot hot plug the snapshot disk. I'm using ovirt 4.2.4 Here is what is see in engine.log 2018-08-04 19:52:30,496-10 ERROR [org.ovirt.engine.core.bll.storage.disk.AttachDiskToVmCommand] (default task-61) [361eca85-ca85-4e23-b292-cd8303a1a86d] Command 'org.ovirt.engine.core.bll.storage.disk.AttachDiskToVmCommand' failed: EngineException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to HotPlugDiskVDS, error = internal error: unable to execute QEMU command 'device_add': Failed to get shared "write" lock, code = 45 (Failed with error FailedToPlugDisk and code 45) Here is the vdsm.log 2018-08-04 19:51:38,512-1000 INFO (jsonrpc/5) [virt.vm] (vmId='78ef239f-3cb3-4eef-921f-f989724009ef') Hotplug disk xml: c312a0c3-8c58-472f-99ad-cfbabb42337d (vm:3859) 2018-08-04 19:51:38,672-1000 ERROR (jsonrpc/5) [virt.vm] (vmId='78ef239f-3cb3-4eef-921f-f989724009ef') Hotplug failed (vm:3867) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/virt/vm.py", line 3865, in hotplugDisk self._dom.attachDevice(driveXml) File "/usr/lib/python2.7/site-packages/vdsm/virt/virdomain.py", line 98, in f ret = attr(*args, **kwargs) File "/usr/lib/python2.7/site-packages/vdsm/common/libvirtconnection.py", line 130, in wrapper ret = f(*args, **kwargs) File "/usr/lib/python2.7/site-packages/vdsm/common/function.py", line 92, in wrapper return func(inst, *args, **kwargs) File "/usr/lib64/python2.7/site-packages/libvirt.py", line 570, in attachDevice if ret == -1: raise libvirtError ('virDomainAttachDevice() failed', dom=self) libvirtError: internal error: unable to execute QEMU command 'device_add': Failed to get shared "write" lock here is libvirtd log in /var/log/messages libvirtd: 2018-08-05 05:51:38.637+: 4967: error : qemuMonitorJSONCheckError:389 : internal error: unable to execute QEMU command 'device_add': Failed to get shared "write" lock Do you guys have any idea of what going on ? How can i check this lock ? ___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/6VWU3RCP4JEEGGQLMPV7XS4BBSTW72F5/
[ovirt-users] Re: Agentless backup solutions
Hello, we a re in the same situation as you. We tried vprotect but at the end, we used the script provided in the python SDK example: https://github.com/oVirt/ovirt-engine-sdk/tree/master/sdk/examples https://github.com/oVirt/ovirt-engine-sdk/blob/master/sdk/examples/vm_backup.py We adapt it. It use the same logic as the one here : https://github.com/zipurman/oVIRT_Simple_Backup We didn't go for zipurman's solution because we actually don't really know how ovirt's plugins work. ___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/Q46VDTGT7R4LLA2CBW565OI2VURQY7NQ/
[ovirt-users] Re: Hardering oVirt Engine
> On Sun, May 27, 2018 at 5:33 AM, Punaatua PK wrote: > > > If https is enabled, the webhook uses the https url to communicate. What > does "gluster-eventsapi status" on any of the gluster nodes return? > [root@test ~]# gluster-eventsapi status Webhooks: http://engine.local.com:80/ovirt-engine/services/glusterevents +--+-+---+ | NODE | NODE STATUS | GLUSTEREVENTSD STATUS | +--+-+---+ | 10.17.14.153 | UP |OK | | 10.17.14.152 | UP |OK | | localhost | UP |OK | +--+-+---+ The webhook is configured with http not https. I think i can modify it to https but i dont know if gluster event api can handle https (the CA may be asked) > > The periodic jobs are run by the Quartz scheduler. ___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/X5FM3O4E7CDE3WWEV3RMSWG74BVC5QKX/
[ovirt-users] Re: logical_name of virtual machine disk not seen in the ovirt engine
it seems that i have the logical_name not populated only with snapshot disk attachment. When i attached a normal disk (ie: i created a disk on ovirt) via webui, the logical_name is populated. Can't really find why but it seems related to snap disk ___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/PTTSGUZIYE5PJA736I3AJL6BLQ5XBZAV/
[ovirt-users] Re: logical_name of virtual machine disk not seen in the ovirt engine
Found an interesting article about how it works https://ovirt.org/develop/release-management/features/storage/reportguestdiskslogicaldevicename/ ___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/B77CX3A6LE4C6EAWVRCBVWILWG3DJMZ3/
[ovirt-users] Re: logical_name of virtual machine disk not seen in the ovirt engine
Even after a long wait, the logical_name is not populated in the engine DB. No idea how to get it populated. ___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/KWXAKROQDHLBO4HL2M37DEQOIFHWDLOD/
[ovirt-users] logical_name of virtual machine disk not seen in the ovirt engine
Hello, i used the vm_backup script as provide here : https://github.com/oVirt/ovirt-engine-sdk/blob/master/sdk/examples/vm_backup.py I understood the process to backup VM. I'm stuck at getting the logical_name of the disk when the snapshot disk is attached in a VM. I checked the flow like this: - The disk is attached on the VM - oVirt guest agent detect the new disk and the mapping seen on the LOG (i did put those log in DEBUG in /etc/ovirt-guest-agent.conf), i also reduce the report_disk_usage to 10 to speed up the process - VDSM on the host get the info from the ovirt guest agent seen by running the following command vdsm-client Host getVMFullList - On the engine the logical_name is empty seen with the following sql request select device,type,device_id, logical_name from vm_device where type='disk' and vm_id='XXX'; ovirt-engine-4.2.3.5-1.el7.centos.noarch vdsm-4.20.27.1-1.el7.centos.x86_64 ovirt-guest-agent-common-1.0.14-1.el7.noarch Do you have an idea ? Is the information request by the engine to VDSM ? VDSM does report to the engine ? What is the flow to get the logical_name populated in the engine DB, python SDK ? I can provide logs if needed. I juste don't know how to enable debug on VDSM (I will take a look for this) ___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/XX56LMYRBV73WWGLEEVMBF2KYOAGYQBS/
[ovirt-users] Re: Hardering oVirt Engine
Any ideas anyone ? At least, could you please provide your opinion ? Regards, ___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/KPQUWIXEU6TVSZAZIQOCGWV4SEKFC5QH/
[ovirt-users] Hardering oVirt Engine
Hello, we are subject to PCI-DSS. I have some questions. We currently have setup oVirt in our environnement. We created 2 Datacenter. - one with a cluster with hosted engine on gluster (Hyperconverged env) which represents the "LAN" part - one with a cluster with gluster storage wich is the DMZ In PCI-DSS we have to secure communication (use HTTPs as much as possible). I did saw that ovirt-ha-agent (on hosted-engine capable host) check the status of the engine by sending GET request on the hosted-engine on port 80 (the same check that hosted-engine --vm-status did in fact). Since ovirt 4.2.2, with the introduction of gluster eventing, a new flow (HTTP post resquest) is needed from gluster nodes to the engine. (In my case, it's a flow from the DMZ to the LAN part in HTTP (non secure) Here is my question. Is it possible to "hardering" this part of the engine ? Another question out of PCI scope. Events like warning and error in the dashboard are clean each days. I tried to find which process did that (look into /etc/cron.daily, root crontab, etc) on the engine without succes. Is there any maintenance task that is run periodicaly ? Could we have the list of all the engine's task ? (regulary check the status of host, vm, storage) also the frequency ? I would appreciate the help. (Great great product ovirt !) Thank you for your jobs ! We did manage KVM hypervisor as standalone machine without all the power that libvirt provides. No need to spend lot of money into licencing product (VSphere and co) ___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org