[ovirt-users] Re: ovirt-imagio-proxy upload speed slow

2019-06-04 Thread Punaatua PK
ovirt-engine-4.2.8.2-1.el7.noarch
ovirt-imageio-proxy-1.4.6-1.el7.noarch
ovirt-imageio-daemon-1.4.6-1.el7.noarch
___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.org/message/OTE6AWQLYPQKNF3YUD2NKNFHULRSBIDI/


[ovirt-users] Re: ovirt-imagio-proxy upload speed slow

2019-06-04 Thread Punaatua PK
Hello,

We have the same problem. It's seems that the ovirt-imageio-proxy is the 
bottleneck for our setup. We use vprotect to backup a VM via api

We ask for support with vprotect team and we are currently tunning some 
parameters on the kernel.

We have full 10G network in ou setup.

Here is the kernel parameter that we set. Did you manage to progress on the 
speed process ?

# Maximum receive socket buffer size
net.core.rmem_max = 134217728 

# Maximum send socket buffer size
net.core.wmem_max = 134217728 

# Minimum, initial and max TCP Receive buffer size in Bytes
net.ipv4.tcp_rmem = 4096 87380 134217728 

# Minimum, initial and max buffer space allocated
net.ipv4.tcp_wmem = 4096 65536 134217728 

# Maximum number of packets queued on the input side
net.core.netdev_max_backlog = 30 

# Auto tuning
net.ipv4.tcp_moderate_rcvbuf =1

# Don't cache ssthresh from previous connection
net.ipv4.tcp_no_metrics_save = 1

# The Hamilton TCP (HighSpeed-TCP) algorithm is a packet loss based congestion 
control and is more aggressive pushing up to max bandwidth (total BDP) and 
favors hosts with lower TTL / VARTTL.
net.ipv4.tcp_congestion_control=htcp

# If you are using jumbo frames set this to avoid MTU black holes.
net.ipv4.tcp_mtu_probing = 1
___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.org/message/PKBHNHPFRZYQCYZRJMDNYGXPAXPYDIBS/


[ovirt-users] From Self-hosted engine to standalone engine

2018-12-03 Thread Punaatua PK
Hello,

we currently have a self-hosted engine on gluster with 3 hosts. We want to have 
the engine on a single machine on a standalone KVM.

We did the following steps on our test platform.
- Create a VM on a standalone KVM
- Put the self hosted engine into global maintenance
- Shut the self-hosted engine
- Copy the self-hosted engine image disk (by browsing into the gluster engine 
volume) by using linux dd command to the standalone KVM
- Reusing the self-hosted engine's MAC address on the new standalone VM
- Starting the standalone VM which use the self-hosted image disk previously 
copied on the standalone KVM

- Log in the engine and then undeploy the hosted-engine by re-installing all 
the host and go for UNDEPLOY on the self-hosted section
- Stop ovirt-ha-agent and ovirt-ha-broker

Everything seems to be ok for now.

What do you think about our process ? (to go from self-hosted to standalone)
Do you have any idea on what should be checked ?

Thank you
(We wanted to go out from self-hosted engine, because we don't really master 
this deployment)
___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.org/message/5UZROLYIC273ARCXUIWHOIIVC3EPGS6E/


[ovirt-users] Re: Migrate datacenter with hosts and VM managed from engine no1 to engine no2

2018-11-14 Thread Punaatua PK
Hello Simone,

at first, let me thank you for your answer.
Ok for the storage domain. I have already done this before.

The storage domain is a glusterfs domain. The glusterfs volume is composed of 3 
hosts which are managed from the 1st engine.
I wanted the detach the hosts, vm, storage domain from that engine and import 
everything on a new engine without loosing gluster volume info

These are the steps I would like to do
- stop all the VM
- put into maintenance the storage domain
- detach the storage domain from the datacenter
- put all the host into maintenance
- remove every host from the datacenter

On the new engine:
- create a new datacenter, cluster
- add the host from the old datacenter (which does have glusterfs's conf) to 
the cluster
- import the storage domain
- import the VM from that storage domain

Well I think I have to give a try on a test platform.
Any advice about those steps ?
___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.org/message/QAFYDJA627IASRX3RT52JX7L5AE2NQK4/


[ovirt-users] Migrate datacenter with hosts and VM managed from engine no1 to engine no2

2018-11-12 Thread Punaatua PK
Hello,

we have the current setup.

=> 1 datacenter on site A with 1 cluster which is compose of 3 hosts and a 
self-hosted engine
=> 1 datacenter on site B (let's call this TATA) with 1 cluster compose of 3 
hosts which is using glusterfs. This datacenter is managed by the self-hosted 
engine on site A

We want to create on site B another datacenter with 1 cluster and another 
self-hosted engine
then disengage datacenter TATA from self-hosted engine on site A.
after that, we want to import all the ressource on the self-hosted engine on 
site B

Is it possible to do this without loosing VM on glusterfs ?
Off course VM will be shutdown during the operation.

I mean, when a host is added on a new datacenter, ovirt will install package if 
necessary. Is there any way that ovirt manager erase actual configuration ?
Is it safe to do this operation ?
___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.org/message/7R3QTNLMP4MQNAUYLRNBTBJLKLHUAVFC/


[ovirt-users] Re: disk_vm_element ERROR: duplicate key value violates unique constraint "pk_disk_vm_element"

2018-08-05 Thread Punaatua PK
Hello Raz,

after looking onto rhev documentation, I did find the "THE ENGINE VACUUM TOOL". 
It seems to "maintains PostgreSQL databases by updating tables and removing 
dead rows, allowing disk space to be reused"

Maybe it will delete old entries ?
___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.org/message/J447KK7C4OBM5F4H3QA5K45HUY7WYW7N/


[ovirt-users] Re: Failed to hot-plug disk

2018-08-05 Thread Punaatua PK
Hello Raz,

yes i saw this bug. But the problem doesn't seem to be the same. I search on 
google with qemu + write lock
but didn't find anything.

Do you know the command launch by this opération ? qemu-img ?
___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.org/message/2OUJ63JSQEZPWZ6X666TZQZQJ2DMGLXS/


[ovirt-users] Re: disk_vm_element ERROR: duplicate key value violates unique constraint "pk_disk_vm_element"

2018-08-05 Thread Punaatua PK
Hi Raz,

yes i saw this bug. But I was focusing on the opération that leads to it which 
is not the same as me. I'm not very familiar with bugzilla.

No solution for the moment for this bug ?
___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.org/message/P5LZI7QDTXKHJJC3CSQRQSJNM7YFWUPF/


[ovirt-users] disk_vm_element ERROR: duplicate key value violates unique constraint "pk_disk_vm_element"

2018-08-05 Thread Punaatua PK
Hello,

when i tried to attach a snapshot disk into my backupvm. oVirt doesn't want to 
attach it.
In the engine.log I can see this.

2018-08-04 19:20:04,472-10 ERROR 
[org.ovirt.engine.core.bll.storage.disk.AttachDiskToVmCommand] (default 
task-33) [646ad7a1-4501-4648-a937-bbee0abaec46] Command 
'org.ovirt.engine.core.bll.storage.disk.AttachDiskToVmCommand' failed: 
CallableStatementCallback; SQL [{call insertdiskvmelement(?, ?, ?, ?, ?, ?)}]; 
ERROR: duplicate key value violates unique constraint "pk_disk_vm_element"
  Detail: Key (vm_id, disk_id)=(78ef239f-3cb3-4eef-921f-f989724009ef, 
c7cef731-e31d-4597-80f1-1f2393cd66ea) already exists.
  Where: SQL statement "INSERT INTO disk_vm_element (
disk_id,
vm_id,
is_boot,
pass_discard,
disk_interface,
is_using_scsi_reservation)
VALUES (
v_disk_id,
v_vm_id,
v_is_boot,
v_pass_discard,
v_disk_interface,
v_is_using_scsi_reservation)"
PL/pgSQL function insertdiskvmelement(uuid,uuid,boolean,boolean,character 
varying,boolean) line 3 at SQL statement; nested exception is 
org.postgresql.util.PSQLException: ERROR: duplicate key value violates unique 
constraint "pk_disk_vm_element"
  Detail: Key (vm_id, disk_id)=(78ef239f-3cb3-4eef-921f-f989724009ef, 
c7cef731-e31d-4597-80f1-1f2393cd66ea) already exists.


When i SQL the database, the entries is present (and many other). But in the 
webinterface, I can't see them on the backupVM. It's just like ovirt didn't 
delete old entries

engine=# select * from disk_vm_element where vm_id = 
'78ef239f-3cb3-4eef-921f-f989724009ef' and disk_id = 
'c7cef731-e31d-4597-80f1-1f2393cd66ea' ;
   disk_id|vm_id | 
is_boot | disk_interface | is_using_scsi_reservation | pass_discard
--+--+-++---+--
 c7cef731-e31d-4597-80f1-1f2393cd66ea | 78ef239f-3cb3-4eef-921f-f989724009ef | 
f   | VirtIO | f | f
(1 row)

Do you guys have any idea on how to correct this ?

Is there any function to update / refresh this table ?
I dont want to delete entries by sql as i  don't know the consequences, is it 
safe to delete entries ?

Thank you for your help
___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.org/message/PXGZ62TGLMO7PTBKVPSTZCEBRAW2L5QK/


[ovirt-users] Failed to hot-plug disk

2018-08-05 Thread Punaatua PK
Hello,

I have a problem when i tried to hotplug a disk to a VM. Here is the situation.

We use a VM (let's call this backupVM) which is responsible of doing our VM 
backup by :
- Making a snapshot of the VM we want to backup
- Attach the snapshot disk
- Make the copy using DD
- Unplug the snapshot disk and then delete snapshot.

For some reason that i don't know, for certain VM, the backupVM cannot hot plug 
the snapshot disk.

I'm using ovirt 4.2.4
Here is what is see in engine.log

2018-08-04 19:52:30,496-10 ERROR 
[org.ovirt.engine.core.bll.storage.disk.AttachDiskToVmCommand] (default 
task-61) [361eca85-ca85-4e23-b292-cd8303a1a86d] Command 
'org.ovirt.engine.core.bll.storage.disk.AttachDiskToVmCommand' failed: 
EngineException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: 
VDSGenericException: VDSErrorException: Failed to HotPlugDiskVDS, error = 
internal error: unable to execute QEMU command 'device_add': Failed to get 
shared "write" lock, code = 45 (Failed with error FailedToPlugDisk and code 45)

Here is the vdsm.log

2018-08-04 19:51:38,512-1000 INFO  (jsonrpc/5) [virt.vm] 
(vmId='78ef239f-3cb3-4eef-921f-f989724009ef') Hotplug disk xml: 



c312a0c3-8c58-472f-99ad-cfbabb42337d


 (vm:3859)
2018-08-04 19:51:38,672-1000 ERROR (jsonrpc/5) [virt.vm] 
(vmId='78ef239f-3cb3-4eef-921f-f989724009ef') Hotplug failed (vm:3867)
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/vdsm/virt/vm.py", line 3865, in 
hotplugDisk
self._dom.attachDevice(driveXml)
  File "/usr/lib/python2.7/site-packages/vdsm/virt/virdomain.py", line 98, in f
ret = attr(*args, **kwargs)
  File "/usr/lib/python2.7/site-packages/vdsm/common/libvirtconnection.py", 
line 130, in wrapper
ret = f(*args, **kwargs)
  File "/usr/lib/python2.7/site-packages/vdsm/common/function.py", line 92, in 
wrapper
return func(inst, *args, **kwargs)
  File "/usr/lib64/python2.7/site-packages/libvirt.py", line 570, in 
attachDevice
if ret == -1: raise libvirtError ('virDomainAttachDevice() failed', 
dom=self)
libvirtError: internal error: unable to execute QEMU command 'device_add': 
Failed to get shared "write" lock

here is libvirtd log in /var/log/messages

libvirtd: 2018-08-05 05:51:38.637+: 4967: error : 
qemuMonitorJSONCheckError:389 : internal error: unable to execute QEMU command 
'device_add': Failed to get shared "write" lock

Do you guys have any idea of what going on ? How can i check this lock ?
___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.org/message/6VWU3RCP4JEEGGQLMPV7XS4BBSTW72F5/


[ovirt-users] Re: Agentless backup solutions

2018-06-19 Thread Punaatua PK
Hello,

we a re in the same situation as you. We tried vprotect but at the end, we used 
the script provided in the python SDK example:
https://github.com/oVirt/ovirt-engine-sdk/tree/master/sdk/examples
https://github.com/oVirt/ovirt-engine-sdk/blob/master/sdk/examples/vm_backup.py

We adapt it. It use the same logic as the one here : 
https://github.com/zipurman/oVIRT_Simple_Backup
We didn't go for zipurman's solution because we actually don't really know how 
ovirt's plugins work.
___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.org/message/Q46VDTGT7R4LLA2CBW565OI2VURQY7NQ/


[ovirt-users] Re: Hardering oVirt Engine

2018-06-19 Thread Punaatua PK
> On Sun, May 27, 2018 at 5:33 AM, Punaatua PK  wrote:
> 
> 
> If https is enabled, the webhook uses the https url to communicate. What
> does "gluster-eventsapi status" on any of the gluster nodes return?
> 
[root@test ~]# gluster-eventsapi status
Webhooks:
http://engine.local.com:80/ovirt-engine/services/glusterevents

+--+-+---+
| NODE | NODE STATUS | GLUSTEREVENTSD STATUS |
+--+-+---+
| 10.17.14.153 |  UP |OK |
| 10.17.14.152 |  UP |OK |
|  localhost   |  UP |OK |
+--+-+---+

The webhook is configured with http not https. I think i can modify it to https 
but i dont know if gluster event api can handle https
(the CA may be asked)
> 
> The periodic jobs are run by the Quartz scheduler.

___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.org/message/X5FM3O4E7CDE3WWEV3RMSWG74BVC5QKX/


[ovirt-users] Re: logical_name of virtual machine disk not seen in the ovirt engine

2018-06-01 Thread Punaatua PK
it seems that i have the logical_name not populated only with snapshot disk 
attachment. When i attached a normal disk (ie: i created a disk on ovirt) via 
webui, the logical_name is populated. Can't really find why but it seems 
related to snap disk
___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.org/message/PTTSGUZIYE5PJA736I3AJL6BLQ5XBZAV/


[ovirt-users] Re: logical_name of virtual machine disk not seen in the ovirt engine

2018-06-01 Thread Punaatua PK
Found an interesting article about how it works

https://ovirt.org/develop/release-management/features/storage/reportguestdiskslogicaldevicename/
___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.org/message/B77CX3A6LE4C6EAWVRCBVWILWG3DJMZ3/


[ovirt-users] Re: logical_name of virtual machine disk not seen in the ovirt engine

2018-06-01 Thread Punaatua PK
Even after a long wait, the logical_name is not populated in the engine DB. No 
idea how to get it populated.
___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.org/message/KWXAKROQDHLBO4HL2M37DEQOIFHWDLOD/


[ovirt-users] logical_name of virtual machine disk not seen in the ovirt engine

2018-05-30 Thread Punaatua PK
Hello,

i used the vm_backup script as provide here : 
https://github.com/oVirt/ovirt-engine-sdk/blob/master/sdk/examples/vm_backup.py

I understood the process to backup VM. I'm stuck at getting the logical_name of 
the disk when the snapshot disk is attached in a VM.

I checked the flow like this:

- The disk is attached on the VM
- oVirt guest agent detect the new disk and the mapping seen on the LOG (i did 
put those log in DEBUG in /etc/ovirt-guest-agent.conf), i also reduce the 
report_disk_usage to 10 to speed up the process
- VDSM on the host get the info from the ovirt guest agent seen by running the 
following command vdsm-client Host getVMFullList
- On the engine the logical_name is empty seen with the following sql request 
select device,type,device_id, logical_name from vm_device where type='disk' and 
vm_id='XXX';

ovirt-engine-4.2.3.5-1.el7.centos.noarch
vdsm-4.20.27.1-1.el7.centos.x86_64
ovirt-guest-agent-common-1.0.14-1.el7.noarch

Do you have an idea ? Is the information request by the engine to VDSM ? VDSM 
does report to the engine ? What is the flow to get the logical_name populated 
in the engine DB, python SDK ? 

I can provide logs if needed. I juste don't know how to enable debug on VDSM (I 
will take a look for this)
___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.org/message/XX56LMYRBV73WWGLEEVMBF2KYOAGYQBS/


[ovirt-users] Re: Hardering oVirt Engine

2018-05-30 Thread Punaatua PK
Any ideas anyone ? At least, could you please provide your opinion ?

Regards,
___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.org/message/KPQUWIXEU6TVSZAZIQOCGWV4SEKFC5QH/


[ovirt-users] Hardering oVirt Engine

2018-05-27 Thread Punaatua PK
Hello,

we are subject to PCI-DSS. I have some questions. We currently have setup oVirt 
in our environnement.
We created 2 Datacenter.
- one with a cluster with hosted engine on gluster (Hyperconverged env) which 
represents the "LAN" part
- one with a cluster with gluster storage wich is the DMZ

In PCI-DSS we have to secure communication (use HTTPs as much as possible). I 
did saw that ovirt-ha-agent (on hosted-engine capable host) check the status of 
the engine by sending GET request on the hosted-engine on port 80 (the same 
check that hosted-engine --vm-status did in fact). 
Since ovirt 4.2.2, with the introduction of gluster eventing, a new flow (HTTP 
post resquest) is needed from gluster nodes to the engine. (In my case, it's a 
flow from the DMZ to the LAN part in HTTP (non secure)

Here is my question. Is it possible to "hardering" this part of the engine ?

Another question out of PCI scope. Events like warning and error in the 
dashboard are clean each days. I tried to find which process did that (look 
into /etc/cron.daily, root crontab, etc) on the engine
without succes. Is there any maintenance task that is run periodicaly ? Could 
we have the list of all the engine's task ? (regulary check the status of host, 
vm, storage) also the frequency ?

I would appreciate the help. (Great great product ovirt !) Thank you for your 
jobs ! We did manage KVM hypervisor as standalone machine without all the power 
that libvirt provides. No need to spend lot of money into licencing product 
(VSphere and co)
___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org