Re: [ovirt-users] Any monitoring tool provided?

2018-03-25 Thread Peter Hudec
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256

Hi Terry,

I started to work on ZABBIX integration based on oVirt API.
Basically it should be like VmWare integration in ZABBIX with full
hosts/vms discovery and statistic gathering.

The API provides  for each statistics service for NIC, VM as wall CPU
and MEM utilization.

There is also solution based on reading data from VDSM to prometheus
http://rmohr.github.io/virtualization/2016/04/12/monitor-your-ovirt-data
center-with-prometheus.


Peter

On 22/03/2018 04:41, Terry hey wrote:
> Dear all,
> 
> Now, we can just read how many storage used, cpu usage on ovirt
> dashboard. But is there any monitoring tool for monitoring virtual
> machine time to time? If yes, could you guys give me the procedure?
> 
> 
> 
> Regards Terry
> 
> 
> ___ Users mailing list 
> Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
> 


- -- 
*Peter Hudec*
Infraštruktúrny architekt
phu...@cnc.sk 

*CNC, a.s.*
Borská 6, 841 04 Bratislava
Recepcia: +421 2  35 000 100

Mobil:+421 905 997 203
*www.cnc.sk* 

-BEGIN PGP SIGNATURE-

iQJCBAEBCAAsFiEEqSUbhuEwhryifNeVQnvVWOJ35BAFAlq4ihEOHHBodWRlY0Bj
bmMuc2sACgkQQnvVWOJ35BC5Xg//YqtoPKtmA8Y0APnQevX+LrRq8EuViWsn1Wfw
Xf2HogPs9vJB8W5PnpI9+jdRTrm4rL74V1qw8LEDWhIoag0n+r/PPk48sRTpQSMM
fkCjaNBL94SBc/Fjic7Gtn6IsTD9puPSmkJ7I6APC+c3RIVfYRaPXTSCW1dHkrzX
BuTHajuvL1Wdns+SSbGdGOGvegYpKfuFgiorm7eZ47WF2tJ1HlKKhYTiFaCTywo7
6gG2u18ezrEWGXa6MSFhw0NytUGC3JFvseA2jHj+NofRFEHpkhSvLgAYSHcJb1uQ
8IvH8gkY2wjYFk5jqqvxoMX9dtYfnZLtW0gtFNVoEzIwcOjuK7aVi/bdfFIl2P9r
CUD9h0O3xEO6BeHo9WZkRwNqOxQVRel/3x/jAu76Q5KPR3U4S7tezuH4xvH0i4g7
uEEc+BSECytfSGPFH41J5X1FflINt4F1tMpjXdaT5qEa9AWYuZddfHeQ9KSDqqBC
KOnr+9xRdhS1VYjm8FI3tpya0Mj/OjBJL2PMpEluJd5IpN9ggcfIlUpyCgAzFnUU
xyIz05pg35iCJ6FQZCYergQwh15RQLb9LTnCuB39wBfSKXeR27uXIZ8/p/8S5Un4
7uJmidsHF7OGtSFk48WwMGFg1in8ZSwbmNnxR1WkJPJAkxxbXp07an+OzugOnsgR
y1b8OkE=
=BKxT
-END PGP SIGNATURE-
___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users


Re: [ovirt-users] Which hardware are you using for oVirt

2018-03-25 Thread Juan Pablo
Andy, Im using 2 node cluster:
-2 supermicro 6017 (2 Intel 2420(12C24T each node) 384Gb ram total, 10gbe.
all hosted engine via nfs

storage side: 2 SC836BE16-R1K28B(192gb arc cache) with raid 10 zfs+intel
slog serving iscsi at 10Gbe
80 VM's more or less.

regards,



2018-03-25 4:36 GMT-03:00 Andy Michielsen :

> Hello Alex,
>
> Thanks for sharing. Much appriciated.
>
> I believe my setup would need 96 Gb off RAM in each host, and would need
> about at least 3 Tb of storage. Probably 4 Tb would be beter if I want to
> work with snapshots. (Will be running mostly windows 2016 servers or
> windows 10 desktops with 6Gb off RAM and 100 Gb of disks)
>
> I agree that a 10 Gb network for storage would be very beneficial.
>
> Now If I can figure out how to set up a glusterfs on a 3 node cluster in
> oVirt 4.2 just for the data storage. I ‘m golden to get started. :-)
>
> Kind regards.
>
> On 24 Mar 2018, at 20:08, Alex K  wrote:
>
> I have 2 or 3 node clusters with following hardware (all with self-hosted
> engine) :
>
> 2 node cluster:
> RAM: 64 GB per host
> CPU: 8 cores per host
> Storage: 4x 1TB SAS in RAID10
> NIC: 2x Gbit
> VMs: 20
>
> The above, although I would like to have had a third NIC for gluster
> storage redundancy, it is running smoothly for quite some time and without
> performance issues.
> The VMs it is running are not high on IO (mostly small Linux servers).
>
> 3 node clusters:
> RAM: 32 GB per host
> CPU: 16 cores per host
> Storage: 5x 600GB in RAID5 (not ideal but I had to gain some storage space
> without purchasing extra disks)
> NIC: 6x Gbit
> VMs: less then 10 large Windows VMs (Windows 2016 server and Windows 10)
>
> For your setup (30 VMs) I would rather go with RAID10 SAS disks and at
> least a dual 10Gbit NIC dedicated to the gluster traffic only.
>
> Alex
>
>
> On Sat, Mar 24, 2018 at 1:24 PM, Andy Michielsen <
> andy.michiel...@gmail.com> wrote:
>
>> Hello Andrei,
>>
>> Thank you very much for sharing info on your hardware setup. Very
>> informative.
>>
>> At this moment I have my ovirt engine on our vmware environment which is
>> fine for good backup and restore.
>>
>> I have 4 nodes running now all different in make and model with local
>> storage and it works but lacks performance a bit.
>>
>> But I can get my hands on some old dell’s R415 with 96 Gb of ram and 2
>> quadcores and 6 x 1 Gb nic’s. They all come with 2 x 146 Gb 15000 rpm’s
>> harddisks. This isn’t bad but I will add more RAM for starters. Also I
>> would like to have some good redundant storage for this too and the servers
>> have limited space to add that.
>>
>> Hopefully others will also share there setups and expirience like you did.
>>
>> Kind regards.
>>
>> On 24 Mar 2018, at 10:35, Andrei Verovski  wrote:
>>
>> Hi,
>>
>> HL ProLiant DL380, dual Xeon
>> 120 GB RAID L1 for system
>> 2 TB RAID L10 for VM disks
>> 5 VMs, 3 Linux, 2 Windows
>> Total CPU load most of the time is  low, high level of activity related
>> to disk.
>> Host engine under KVM appliance on SuSE, can be easily moved, backed up,
>> copied, experimented with, etc.
>>
>> You'll have to use servers with more RAM and storage than main.
>> More then one NIC required if some of your VMs are on different subnets,
>> e.g. 1 in internal zone and 2nd on DMZ.
>> For your setup 10 GB NICs + L3 Switch for ovirtmgmt.
>>
>> BTW, I would suggest to have several separate hardware RAIDs unless you
>> have SSD, otherwise limit of the disk system I/O will be a bottleneck.
>> Consider SSD L1 RAID for heavy-loaded databases.
>>
>> *Please note many cheap SSDs do NOT work reliably with SAS controllers
>> even in SATA mode*.
>>
>> For example, I supposed to use 2 x WD Green SSD configures as RAID L1 for
>> OS.
>> It was possible to install system, yet under heavy load simulated with
>> iozone disk system freeze, rendering OS unbootable.
>> Same crash was experienced with 512GB KingFast SSD connected to
>> broadcom/AMCC SAS RAID Card.
>>
>>
>> On 03/24/2018 10:33 AM, Andy Michielsen wrote:
>>
>> Hi all,
>>
>> Not sure if this is the place to be asking this but I was wondering which 
>> hardware you all are using and why in order for me to see what I would be 
>> needing.
>>
>> I would like to set up a HA cluster consisting off 3 hosts to be able to run 
>> 30 vm’s.
>> The engine, I can run on an other server. The hosts can be fitted with the 
>> storage and share the space through glusterfs. I would think I will be 
>> needing at least 3 nic’s but would be able to install ovn. (Are 1gb nic’s 
>> sufficient ?)
>>
>> Any input you guys would like to share would be greatly appriciated.
>>
>> Thanks,
>> ___
>> Users mailing 
>> listUsers@ovirt.orghttp://lists.ovirt.org/mailman/listinfo/users
>>
>>
>>
>> ___
>> Users mailing list
>> Users@ovirt.org
>> http://lists.ovirt.org/mailman/listinfo/users
>>
>>
>
> 

[ovirt-users] ovirt snapshot issue

2018-03-25 Thread Alex K
Hi folks,

I am facing frequently the following issue:

On some large VMs (Windows 2016 with two disk drives, 60GB and 500GB) when
attempting to create a snapshot of the VM, the VM becomes unresponsive.

The errors that I managed to collect were:

vdsm error at host hosting the VM:
2018-03-25 14:40:13,442+ WARN  (vdsm.Scheduler) [Executor] Worker
blocked:  timeout=60, duration=60 at 0x39d8210> task#=155842 at
0x2240e10> (executor:351)
2018-03-25 14:40:15,261+ INFO  (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC
call VM.getStats failed (error 1) in 0.01 seconds (__init__:539)
2018-03-25 14:40:17,471+ WARN  (jsonrpc/5) [virt.vm]
(vmId='a5c761a2-41cd-40c2-b65f-f3819293e8a4') monitor became unresponsive
(command timeout, age=67.910001) (vm:5132)

engine.log:
2018-03-25 14:40:19,875Z WARN
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
(DefaultQuartzScheduler2) [1d737df7] EVENT_ID: VM_NOT_RESPONDING(126),
Correlation ID: null, Call Stack: null, Custom ID: null, Custom Event ID:
-1, Message: VM Data-Server is not responding.

2018-03-25 14:42:13,708Z ERROR
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
(DefaultQuartzScheduler5) [17789048-009a-454b-b8ad-2c72c7cd37aa] EVENT_ID:
VDS_BROKER_COMMAND_FAILURE(10,802), Correlation ID: null, Call Stack: null,
Custom ID: null, Custom Event ID: -1, Message: VDSM v1.cluster command
SnapshotVDS failed: Message timeout which can be caused by communication
issues
2018-03-25 14:42:13,708Z ERROR
[org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand]
(DefaultQuartzScheduler5) [17789048-009a-454b-b8ad-2c72c7cd37aa] Command
'SnapshotVDSCommand(HostName = v1.cluster,
SnapshotVDSCommandParameters:{runAsync='true',
hostId='a713d988-ee03-4ff0-a0cd-dc4cde1507f4',
vmId='a5c761a2-41cd-40c2-b65f-f3819293e8a4'})' execution failed:
VDSGenericException: VDSNetworkException: Message timeout which can be
caused by communication issues
2018-03-25 14:42:13,708Z WARN
[org.ovirt.engine.core.bll.snapshots.CreateAllSnapshotsFromVmCommand]
(DefaultQuartzScheduler5) [17789048-009a-454b-b8ad-2c72c7cd37aa] Could not
perform live snapshot due to error, VM will still be configured to the new
created snapshot: EngineException:
org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException:
VDSGenericException: VDSNetworkException: Message timeout which can be
caused by communication issues (Failed with error VDS_NETWORK_ERROR and
code 5022)
2018-03-25 14:42:13,708Z WARN  [org.ovirt.engine.core.vdsbroker.VdsManager]
(org.ovirt.thread.pool-6-thread-15) [17789048-009a-454b-b8ad-2c72c7cd37aa]
Host 'v1.cluster' is not responding. It will stay in Connecting state for a
grace period of 61 seconds and after that an attempt to fence the host will
be issued.
2018-03-25 14:42:13,725Z WARN
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
(org.ovirt.thread.pool-6-thread-15) [17789048-009a-454b-b8ad-2c72c7cd37aa]
EVENT_ID: VDS_HOST_NOT_RESPONDING_CONNECTING(9,008), Correlation ID: null,
Call Stack: null, Custom ID: null, Custom Event ID: -1, Message: Host
v1.cluster is not responding. It will stay in Connecting state for a grace
period of 61 seconds and after that an attempt to fence the host will be
issued.
2018-03-25 14:42:13,751Z WARN
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
(DefaultQuartzScheduler5) [17789048-009a-454b-b8ad-2c72c7cd37aa] EVENT_ID:
USER_CREATE_LIVE_SNAPSHOT_FINISHED_FAILURE(170), Correlation ID:
17789048-009a-454b-b8ad-2c72c7cd37aa, Job ID:
16e48c28-a8c7-4841-bd81-1f2d370f345d, Call Stack:
org.ovirt.engine.core.common.errors.EngineException: EngineException:
org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException:
VDSGenericException: VDSNetworkException: Message timeout which can be
caused by communication issues (Failed with error VDS_NETWORK_ERROR and
code 5022)
2018-03-25 14:42:14,372Z ERROR
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
(DefaultQuartzScheduler5) [] EVENT_ID:
USER_CREATE_SNAPSHOT_FINISHED_FAILURE(69), Correlation ID:
17789048-009a-454b-b8ad-2c72c7cd37aa, Job ID:
16e48c28-a8c7-4841-bd81-1f2d370f345d, Call Stack:
org.ovirt.engine.core.common.errors.EngineException: EngineException:
org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException:
VDSGenericException: VDSNetworkException: Message timeout which can be
caused by communication issues (Failed with error VDS_NETWORK_ERROR and
code 5022)
2018-03-25 14:42:14,372Z WARN
[org.ovirt.engine.core.bll.ConcurrentChildCommandsExecutionCallback]
(DefaultQuartzScheduler5) [] Command 'CreateAllSnapshotsFromVm' id:
'bad4f5be-5306-413f-a86a-513b3cfd3c66' end method execution failed, as the
command isn't marked for endAction() retries silently ignoring
2018-03-25 14:42:15,951Z WARN
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
(DefaultQuartzScheduler5) [5017c163] EVENT_ID:
VDS_NO_SELINUX_ENFORCEMENT(25), Correlation ID: null, Call Stack: null,
Custom ID: null, Custom Event 

Re: [ovirt-users] Any monitoring tool provided?

2018-03-25 Thread Shirly Radco
It is possible to use DWH with Grafana to get VMs stats.
https://www.ovirt.org/blog/2018/01/ovirt-report-using-grafana/

Relevant views are with the following prefixes:

v4_2_statistics_vms_*
v4_2_latest_configuration_vms*
v4_2_configuration_history_vms*

They are all available also in earlier versions but the prefix will be
different, like v4_1_* for 4.1.


Another option is our new real time monitoring solution , which is based on
OpenShift and Elasticearch, Kibana and Fluentd.
https://ovirt.org/blog/2017/12/ovirt-metrics-store


--

SHIRLY RADCO

BI SeNIOR SOFTWARE ENGINEER

Red Hat Israel 

TRIED. TESTED. TRUSTED. 

On Thu, Mar 22, 2018 at 5:41 AM, Terry hey  wrote:

> Dear all,
>
> Now, we can just read how many storage used, cpu usage on ovirt dashboard.
> But is there any monitoring tool for monitoring virtual machine time to
> time?
> If yes, could you guys give me the procedure?
>
>
> Regards
> Terry
>
> ___
> Users mailing list
> Users@ovirt.org
> http://lists.ovirt.org/mailman/listinfo/users
>
>
___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users


Re: [ovirt-users] Any monitoring tool provided?

2018-03-25 Thread Marcelo Leandro
Good morning ,
Very thanks shirly, I will try.

Marcelo Leandro

Em Dom, 25 de mar de 2018 06:01, Shirly Radco  escreveu:

>
>
> --
>
> SHIRLY RADCO
>
> BI SeNIOR SOFTWARE ENGINEER
>
> Red Hat Israel 
> 
> TRIED. TESTED. TRUSTED. 
>
> On Fri, Mar 23, 2018 at 10:29 PM, Marcelo Leandro 
> wrote:
>
>> Hello,
>>
>> I am try this how to:
>>
>>
>> https://www.ovirt.org/develop/release-management/features/metrics/metrics-store-installation/
>>
>> but when i run this command:
>>
>> /usr/share/ovirt-engine-metrics/setup/ansible/configure_ovirt_machines_for_metrics.sh
>>   --playbook=ovirt-metrics-store-installation.yml
>>
>> I am had this error mensagem:
>> ansible-playbook: error: no such option: --playbook
>>
>> my version:
>>
>> ovirt-engine-metrics-1.0.8-1.el7.centos.noarch
>>
>
> Hi,
>
> You are using an old rpm.
>
> Please upgrade to latest, ovirt-engine-metrics-1.1.3.3-1.el7.centos.noarch
>
> I also added some documentation that is still in pull request:
>
> Add Viaq installation guide to the oVirt metrics store repo -
> https://github.com/oVirt/ovirt-site/pull/1551 - This one is meaningful. I
> introduced a lot of automation that save time when installing.
>
> Add prerequisites for installing OpenShift Logging -
> https://github.com/oVirt/ovirt-site/pull/1561
>
> Added how to import dashboards examples to kibana -
> https://github.com/oVirt/ovirt-site/pull/1559
>
> Please review them.I'll try to get them merged asap.
>
>
>>
>> Anyone can help me?
>>
>>
>> 2018-03-22 16:28 GMT-03:00 Christopher Cox :
>>
>>> On 03/21/2018 10:41 PM, Terry hey wrote:
>>>
 Dear all,

 Now, we can just read how many storage used, cpu usage on ovirt
 dashboard.
 But is there any monitoring tool for monitoring virtual machine time to
 time?
 If yes, could you guys give me the procedure?

>>>
>>> A possible option, for a full OS with network connectivity, is to
>>> monitor the VM like you would any other host.
>>>
>>> We use omd/check_mk.
>>>
>>> Right now there isn't an oVirt specific monitor plugin for check_mk.
>>>
>>> I know what I said is probably pretty obvious, but just in case.
>>>
>>> ___
>>> Users mailing list
>>> Users@ovirt.org
>>> http://lists.ovirt.org/mailman/listinfo/users
>>>
>>
>>
>> ___
>> Users mailing list
>> Users@ovirt.org
>> http://lists.ovirt.org/mailman/listinfo/users
>>
>>
>
___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users


Re: [ovirt-users] Any monitoring tool provided?

2018-03-25 Thread Shirly Radco
--

SHIRLY RADCO

BI SeNIOR SOFTWARE ENGINEER

Red Hat Israel 

TRIED. TESTED. TRUSTED. 

On Fri, Mar 23, 2018 at 10:29 PM, Marcelo Leandro 
wrote:

> Hello,
>
> I am try this how to:
>
> https://www.ovirt.org/develop/release-management/features/
> metrics/metrics-store-installation/
>
> but when i run this command:
> /usr/share/ovirt-engine-metrics/setup/ansible/
> configure_ovirt_machines_for_metrics.sh  --playbook=ovirt-
> metrics-store-installation.yml
>
> I am had this error mensagem:
> ansible-playbook: error: no such option: --playbook
>
> my version:
>
> ovirt-engine-metrics-1.0.8-1.el7.centos.noarch
>

Hi,

You are using an old rpm.

Please upgrade to latest, ovirt-engine-metrics-1.1.3.3-1.el7.centos.noarch

I also added some documentation that is still in pull request:

Add Viaq installation guide to the oVirt metrics store repo -
https://github.com/oVirt/ovirt-site/pull/1551 - This one is meaningful. I
introduced a lot of automation that save time when installing.

Add prerequisites for installing OpenShift Logging -
https://github.com/oVirt/ovirt-site/pull/1561

Added how to import dashboards examples to kibana -
https://github.com/oVirt/ovirt-site/pull/1559

Please review them.I'll try to get them merged asap.


>
> Anyone can help me?
>
>
> 2018-03-22 16:28 GMT-03:00 Christopher Cox :
>
>> On 03/21/2018 10:41 PM, Terry hey wrote:
>>
>>> Dear all,
>>>
>>> Now, we can just read how many storage used, cpu usage on ovirt
>>> dashboard.
>>> But is there any monitoring tool for monitoring virtual machine time to
>>> time?
>>> If yes, could you guys give me the procedure?
>>>
>>
>> A possible option, for a full OS with network connectivity, is to monitor
>> the VM like you would any other host.
>>
>> We use omd/check_mk.
>>
>> Right now there isn't an oVirt specific monitor plugin for check_mk.
>>
>> I know what I said is probably pretty obvious, but just in case.
>>
>> ___
>> Users mailing list
>> Users@ovirt.org
>> http://lists.ovirt.org/mailman/listinfo/users
>>
>
>
> ___
> Users mailing list
> Users@ovirt.org
> http://lists.ovirt.org/mailman/listinfo/users
>
>
___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users


Re: [ovirt-users] FC LUN

2018-03-25 Thread Nir Soffer
בתאריך יום ו׳, 23 במרץ 2018, 20:04, מאת Стаценко Константин Юрьевич ‏<
statsenko...@interrao.ru>:

> Hello!
>
> Can you, please, help ?
>
> There is a strange error while trying to connect FC LUN from the old SAN
> storage system to oVirt 4.1.9 hosts.
>
> In the same time there are no problems with LUN’s from other storage
> systems.
>
> The error in vdsm.log is:
>
>
>
> 2018-03-23 16:41:55,920+0300 INFO  (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC
> call Host.getStats succeeded in 0.09 seconds (__init__:539)
>
> 2018-03-23 16:41:55,965+0300 WARN  (jsonrpc/1) [storage.LVM] lvm pvs
> failed: 5 [] ['  Failed to find device for physical volume
> "/dev/mapper/320080013789309c0".'] (lvm
>
> :323)
>
> 2018-03-23 16:41:55,966+0300 WARN  (jsonrpc/1) [storage.HSM] getPV failed
> for guid: 320080013789309c0 (hsm:1966)
>
> Traceback (most recent call last):
>
>   File "/usr/share/vdsm/storage/hsm.py", line 1963, in _getDeviceList
>
> pv = lvm.getPV(guid)
>
>   File "/usr/share/vdsm/storage/lvm.py", line 853, in getPV
>
> raise se.InaccessiblePhysDev((pvName,))
>
> InaccessiblePhysDev: Multipath cannot access physical device(s):
> "devices=(u'320080013789309c0',)"
>
This error is bogus, you can ignore it.

It was fixed in 4.2 by not trying to get pv info for a lun that was just
added an likely will not have pv info.

Nir

>
>
> Thank you.
> ___
> Users mailing list
> Users@ovirt.org
> http://lists.ovirt.org/mailman/listinfo/users
>
___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users


Re: [ovirt-users] Fwd: Can't add/remove usb device to VM

2018-03-25 Thread Arik Hadas
On Mon, Feb 12, 2018 at 6:57 PM, Jon bae  wrote:

> A little update:
> I found out that I have to activate *Hostdev Passthrough* (is this really
> necessary for USB devices?). Now I see all the devices and I can add also
> an USB device.
>

Theoretically, no, it is not needed.
Practically, it is needed in previous versions of 4.2 due to a bug that
would be solved in the upcoming version of 4.2 [1].


> But I'm still not able to disconnect the USB from the old VM.
>

Yep, that's another bug that would be solved in the upcoming version of 4.2
[2].

[1] https://bugzilla.redhat.com/show_bug.cgi?id=1548344
[2] https://bugzilla.redhat.com/show_bug.cgi?id=155


>
> -- Forwarded message --
> From: Jon bae 
> Date: 2018-02-12 16:14 GMT+01:00
> Subject: Can't add/remove usb device to VM
> To: users 
>
>
> Hello,
> I run oVirt 4.2.1, in 4.1 I added a USB device to a VM and now I wanted to
> change this device to a different VM.
> But I found out, that I'm not able to remove this device nor I'm able to
> add any device to any VM. The device list is empty.
>
> I found a bug report, what describe this error:
> https://bugzilla.redhat.com/show_bug.cgi?id=1531847
>
> Is there a solution for that?
>
> The USB device is a hardware dongle and it is very impotent for us to
> change this.
>

> Any workaround is welcome!
>

If you can't wait for the upcoming version of 4.2 you can try removing it
manually by manipulating the database (assuming there is only one host
device attached to the VM):

(1) delete from vm_device where vm_id in (select vm_guid from vm_static
where vm_name='') and type='hostdev';
(2) update host_device set vm_id = NULL where vm_id in (select vm_guid from
vm_static where vm_name='');


>
> Regards
>
> Jonathan
>
>
> ___
> Users mailing list
> Users@ovirt.org
> http://lists.ovirt.org/mailman/listinfo/users
>
>
___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users


Re: [ovirt-users] Cannot remove VM

2018-03-25 Thread Arik Hadas
On Wed, Mar 21, 2018 at 11:54 AM, Angel R. Gonzalez 
wrote:

> Hi,
>
> I can't edit/remove/modify a VM. Always show a message:
> "Cannot remove VM. Related operation is currently in progress. Please
> try again later"
>

That means that the VM is locked using an in-memory lock (rather than in
the database, so the script for unlocking entities would not help here).
The message you get was deprecated, when a lock is taken before executing a
long operation we generate a more informative message.
So that is almost certainly caused by a bug, we have fixed various bugs
that could have lead to that.
What version of oVirt do you use? Could you share the engine.log that
covers the latest operation that was made on this VM?
Anyway, restarting the engine would most probably release the lock of that
VM and allow removing it.


>
> I also used REST API
> curl -k -u admin@internal:passwd -X DELETE https://engine/ovirt-engine/ap
> i/vms/
> and the output message is the same.
>

Yeah, it doesn't matter what client you use since this error is generated
on the back-end side.


>
> How to can execute actions over the VM, or how to remove it from Cluster?
>
> Thanks in advance.
>
> Ángel González.
> ___
> Users mailing list
> Users@ovirt.org
> http://lists.ovirt.org/mailman/listinfo/users
>
___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users


Re: [ovirt-users] Which hardware are you using for oVirt

2018-03-25 Thread Andy Michielsen
Hello Alex,

Thanks for sharing. Much appriciated.

I believe my setup would need 96 Gb off RAM in each host, and would need about 
at least 3 Tb of storage. Probably 4 Tb would be beter if I want to work with 
snapshots. (Will be running mostly windows 2016 servers or windows 10 desktops 
with 6Gb off RAM and 100 Gb of disks)

I agree that a 10 Gb network for storage would be very beneficial.

Now If I can figure out how to set up a glusterfs on a 3 node cluster in oVirt 
4.2 just for the data storage. I ‘m golden to get started. :-)

Kind regards.

> On 24 Mar 2018, at 20:08, Alex K  wrote:
> 
> I have 2 or 3 node clusters with following hardware (all with self-hosted 
> engine) : 
> 
> 2 node cluster: 
> RAM: 64 GB per host
> CPU: 8 cores per host
> Storage: 4x 1TB SAS in RAID10
> NIC: 2x Gbit
> VMs: 20
> 
> The above, although I would like to have had a third NIC for gluster storage 
> redundancy, it is running smoothly for quite some time and without 
> performance issues. 
> The VMs it is running are not high on IO (mostly small Linux servers). 
> 
> 3 node clusters: 
> RAM: 32 GB per host
> CPU: 16 cores per host
> Storage: 5x 600GB in RAID5 (not ideal but I had to gain some storage space 
> without purchasing extra disks)
> NIC: 6x Gbit
> VMs: less then 10 large Windows VMs (Windows 2016 server and Windows 10)
> 
> For your setup (30 VMs) I would rather go with RAID10 SAS disks and at least 
> a dual 10Gbit NIC dedicated to the gluster traffic only. 
> 
> Alex
> 
> 
>> On Sat, Mar 24, 2018 at 1:24 PM, Andy Michielsen  
>> wrote:
>> Hello Andrei,
>> 
>> Thank you very much for sharing info on your hardware setup. Very 
>> informative.
>> 
>> At this moment I have my ovirt engine on our vmware environment which is 
>> fine for good backup and restore.
>> 
>> I have 4 nodes running now all different in make and model with local 
>> storage and it works but lacks performance a bit.
>> 
>> But I can get my hands on some old dell’s R415 with 96 Gb of ram and 2 
>> quadcores and 6 x 1 Gb nic’s. They all come with 2 x 146 Gb 15000 rpm’s 
>> harddisks. This isn’t bad but I will add more RAM for starters. Also I would 
>> like to have some good redundant storage for this too and the servers have 
>> limited space to add that.
>> 
>> Hopefully others will also share there setups and expirience like you did.
>> 
>> Kind regards.
>> 
>>> On 24 Mar 2018, at 10:35, Andrei Verovski  wrote:
>>> 
>>> Hi,
>>> 
>>> HL ProLiant DL380, dual Xeon
>>> 120 GB RAID L1 for system
>>> 2 TB RAID L10 for VM disks
>>> 5 VMs, 3 Linux, 2 Windows
>>> Total CPU load most of the time is  low, high level of activity related to 
>>> disk.
>>> Host engine under KVM appliance on SuSE, can be easily moved, backed up, 
>>> copied, experimented with, etc.
>>> 
>>> You'll have to use servers with more RAM and storage than main.
>>> More then one NIC required if some of your VMs are on different subnets, 
>>> e.g. 1 in internal zone and 2nd on DMZ.
>>> For your setup 10 GB NICs + L3 Switch for ovirtmgmt.
>>> 
>>> BTW, I would suggest to have several separate hardware RAIDs unless you 
>>> have SSD, otherwise limit of the disk system I/O will be a bottleneck. 
>>> Consider SSD L1 RAID for heavy-loaded databases.
>>> 
>>> Please note many cheap SSDs do NOT work reliably with SAS controllers even 
>>> in SATA mode.
>>> 
>>> For example, I supposed to use 2 x WD Green SSD configures as RAID L1 for 
>>> OS. 
>>> It was possible to install system, yet under heavy load simulated with 
>>> iozone disk system freeze, rendering OS unbootable.
>>> Same crash was experienced with 512GB KingFast SSD connected to 
>>> broadcom/AMCC SAS RAID Card.
>>> 
>>> 
 On 03/24/2018 10:33 AM, Andy Michielsen wrote:
 Hi all,
 
 Not sure if this is the place to be asking this but I was wondering which 
 hardware you all are using and why in order for me to see what I would be 
 needing.
 
 I would like to set up a HA cluster consisting off 3 hosts to be able to 
 run 30 vm’s.
 The engine, I can run on an other server. The hosts can be fitted with the 
 storage and share the space through glusterfs. I would think I will be 
 needing at least 3 nic’s but would be able to install ovn. (Are 1gb nic’s 
 sufficient ?)
 
 Any input you guys would like to share would be greatly appriciated.
 
 Thanks,
 ___
 Users mailing list
 Users@ovirt.org
 http://lists.ovirt.org/mailman/listinfo/users
>>> 
>> 
>> ___
>> Users mailing list
>> Users@ovirt.org
>> http://lists.ovirt.org/mailman/listinfo/users
>> 
> 
___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users


Re: [ovirt-users] [Gluster-users] GlusterFS performance with only one drive per host?

2018-03-25 Thread Vlad Kopylov
The bottleneck is definitely not the disk speed with glusterFS, no
point of using SSD for bricks what so ever

-v

On Thu, Mar 22, 2018 at 6:01 AM, Sahina Bose  wrote:
>
>
> On Mon, Mar 19, 2018 at 5:57 PM, Jayme  wrote:
>>
>> I'm spec'ing a new oVirt build using three Dell R720's w/ 256GB.  I'm
>> considering storage options.  I don't have a requirement for high amounts of
>> storage, I have a little over 1TB to store but want some overhead so I'm
>> thinking 2TB of usable space would be sufficient.
>>
>> I've been doing some research on Micron 1100 2TB ssd's and they seem to
>> offer a lot of value for the money.  I'm considering using smaller cheaper
>> SSDs for boot drives and using one 2TB micron SSD in each host for a
>> glusterFS replica 3 setup (on the fence about using an arbiter, I like the
>> extra redundancy replicate 3 will give me).
>>
>> My question is, would I see a performance hit using only one drive in each
>> host with glusterFS or should I try to add more physical disks.  Such as 6
>> 1TB drives instead of 3 2TB drives?
>
>
> [Adding gluster-users for inputs here]
>
>>
>> Also one other question.  I've read that gluster can only be done in
>> groups of three.  Meaning you need 3, 6, or 9 hosts.  Is this true?  If I
>> had an operational replicate 3 glusterFS setup and wanted to add more
>> capacity I would have to add 3 more hosts, or is it possible for me to add a
>> 4th host in to the mix for extra processing power down the road?
>
>
> In oVirt, we support replica 3 or replica 3 with arbiter (where one of the 3
> bricks is a low storage arbiter brick). To expand storage, you would need to
> add in multiples of 3 bricks. However if you only want to expand compute
> capacity in your HC environment, you can add a 4th node.
>
>>
>> Thanks!
>>
>>
>> ___
>> Users mailing list
>> Users@ovirt.org
>> http://lists.ovirt.org/mailman/listinfo/users
>>
>
>
> ___
> Gluster-users mailing list
> gluster-us...@gluster.org
> http://lists.gluster.org/mailman/listinfo/gluster-users
___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users


Re: [ovirt-users] [Gluster-users] GlusterFS performance with only one drive per host?

2018-03-25 Thread Manoj Pillai
My take is that unless you have loads of data and are trying to optimize
for cost/TB, HDDs are probably not the right choice. This is particularly
true for random I/O workloads for which HDDs are really quite bad.

I'd recommend a recent gluster release, and some tuning because the default
settings are not optimized for performance. Some options to consider:
client.event-threads
server.event-threads
cluster.choose-local
performance.client-io-threads

You can toggle the last two and see what works for you. You'd probably need
to set event-threads to 4 or more. Ideally you'd tune some of the thread
pools based on observed bottlenecks in collected stats. top (top -bHd 10 >
top_threads.out.txt) is great for this. Using 6 small drives/bricks instead
of 3 is also a good idea to reduce likelihood of rpc bottlenecks.

There has been an effort to improve gluster performance over fast SSDs.
Hence the recommendation to try with a recent release. You can also check
in on some of the issues being worked on:
https://github.com/gluster/glusterfs/issues/412
https://github.com/gluster/glusterfs/issues/410

-- Manoj

On Sat, Mar 24, 2018 at 4:14 AM, Jayme  wrote:

> Do you feel that SSDs are worth the extra cost or am I better off using
> regular HDDs?  I'm looking for the best performance I can get with glusterFS
>
> On Fri, Mar 23, 2018 at 12:03 AM, Manoj Pillai  wrote:
>
>>
>>
>> On Thu, Mar 22, 2018 at 3:31 PM, Sahina Bose  wrote:
>>
>>>
>>>
>>> On Mon, Mar 19, 2018 at 5:57 PM, Jayme  wrote:
>>>
 I'm spec'ing a new oVirt build using three Dell R720's w/ 256GB.  I'm
 considering storage options.  I don't have a requirement for high amounts
 of storage, I have a little over 1TB to store but want some overhead so I'm
 thinking 2TB of usable space would be sufficient.

 I've been doing some research on Micron 1100 2TB ssd's and they seem to
 offer a lot of value for the money.  I'm considering using smaller cheaper
 SSDs for boot drives and using one 2TB micron SSD in each host for a
 glusterFS replica 3 setup (on the fence about using an arbiter, I like the
 extra redundancy replicate 3 will give me).

 My question is, would I see a performance hit using only one drive in
 each host with glusterFS or should I try to add more physical disks.  Such
 as 6 1TB drives instead of 3 2TB drives?

>>>
>> It is possible. With SSDs the rpc layer can become the bottleneck with
>> some workloads, especially if there are not enough connections out to the
>> server side. We had experimented with a multi-connection model for this
>> reason:  https://review.gluster.org/#/c/19133/.
>>
>> -- Manoj
>>
>>>
>>> [Adding gluster-users for inputs here]
>>>
>>>
 Also one other question.  I've read that gluster can only be done in
 groups of three.  Meaning you need 3, 6, or 9 hosts.  Is this true?  If I
 had an operational replicate 3 glusterFS setup and wanted to add more
 capacity I would have to add 3 more hosts, or is it possible for me to add
 a 4th host in to the mix for extra processing power down the road?

>>>
>>> In oVirt, we support replica 3 or replica 3 with arbiter (where one of
>>> the 3 bricks is a low storage arbiter brick). To expand storage, you would
>>> need to add in multiples of 3 bricks. However if you only want to expand
>>> compute capacity in your HC environment, you can add a 4th node.
>>>
>>>
 Thanks!


 ___
 Users mailing list
 Users@ovirt.org
 http://lists.ovirt.org/mailman/listinfo/users


>>>
>>> ___
>>> Gluster-users mailing list
>>> gluster-us...@gluster.org
>>> http://lists.gluster.org/mailman/listinfo/gluster-users
>>>
>>
>>
>
___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users


Re: [ovirt-users] [Gluster-users] GlusterFS performance with only one drive per host?

2018-03-25 Thread Manoj Pillai
On Thu, Mar 22, 2018 at 3:31 PM, Sahina Bose  wrote:

>
>
> On Mon, Mar 19, 2018 at 5:57 PM, Jayme  wrote:
>
>> I'm spec'ing a new oVirt build using three Dell R720's w/ 256GB.  I'm
>> considering storage options.  I don't have a requirement for high amounts
>> of storage, I have a little over 1TB to store but want some overhead so I'm
>> thinking 2TB of usable space would be sufficient.
>>
>> I've been doing some research on Micron 1100 2TB ssd's and they seem to
>> offer a lot of value for the money.  I'm considering using smaller cheaper
>> SSDs for boot drives and using one 2TB micron SSD in each host for a
>> glusterFS replica 3 setup (on the fence about using an arbiter, I like the
>> extra redundancy replicate 3 will give me).
>>
>> My question is, would I see a performance hit using only one drive in
>> each host with glusterFS or should I try to add more physical disks.  Such
>> as 6 1TB drives instead of 3 2TB drives?
>>
>
It is possible. With SSDs the rpc layer can become the bottleneck with some
workloads, especially if there are not enough connections out to the server
side. We had experimented with a multi-connection model for this reason:
https://review.gluster.org/#/c/19133/.

-- Manoj

>
> [Adding gluster-users for inputs here]
>
>
>> Also one other question.  I've read that gluster can only be done in
>> groups of three.  Meaning you need 3, 6, or 9 hosts.  Is this true?  If I
>> had an operational replicate 3 glusterFS setup and wanted to add more
>> capacity I would have to add 3 more hosts, or is it possible for me to add
>> a 4th host in to the mix for extra processing power down the road?
>>
>
> In oVirt, we support replica 3 or replica 3 with arbiter (where one of the
> 3 bricks is a low storage arbiter brick). To expand storage, you would need
> to add in multiples of 3 bricks. However if you only want to expand compute
> capacity in your HC environment, you can add a 4th node.
>
>
>> Thanks!
>>
>>
>> ___
>> Users mailing list
>> Users@ovirt.org
>> http://lists.ovirt.org/mailman/listinfo/users
>>
>>
>
> ___
> Gluster-users mailing list
> gluster-us...@gluster.org
> http://lists.gluster.org/mailman/listinfo/gluster-users
>
___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users


Re: [ovirt-users] FC LUN

2018-03-25 Thread Стаценко Константин Юрьевич
Zoning is correct. Mutipath shows this LUN on every host in the DC.

From: Николаев Алексей [mailto:alexeynikolaev.p...@yandex.ru]
Sent: Saturday, March 24, 2018 7:19 PM
To: Стаценко Константин Юрьевич ; users 

Subject: Re: [ovirt-users] FC LUN

Hi, Konstantin.

What “multipath -ll” command says? Execute on every node that have access to 
the SAN.

Is any zoning on SAN fabrics?

--
Отправлено из мобильной Яндекс.Почты

24.03.2018, 14:38, "Стаценко Константин Юрьевич" 
>:


Anyone ? Any ideas ?



From: users-boun...@ovirt.org 
[mailto:users-boun...@ovirt.org] On Behalf Of 
Стаценко Константин Юрьевич
Sent: Friday, March 23, 2018 7:53 PM
To: users >
Subject: [ovirt-users] FC LUN



Hello!

Can you, please, help ?

There is a strange error while trying to connect FC LUN from the old SAN 
storage system to oVirt 4.1.9 hosts.

In the same time there are no problems with LUN’s from other storage systems.

The error in vdsm.log is:



2018-03-23 16:41:55,920+0300 INFO  (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call 
Host.getStats succeeded in 0.09 seconds (__init__:539)

2018-03-23 16:41:55,965+0300 WARN  (jsonrpc/1) [storage.LVM] lvm pvs failed: 5 
[] ['  Failed to find device for physical volume 
"/dev/mapper/320080013789309c0".'] (lvm

:323)

2018-03-23 16:41:55,966+0300 WARN  (jsonrpc/1) [storage.HSM] getPV failed for 
guid: 320080013789309c0 (hsm:1966)

Traceback (most recent call last):

  File "/usr/share/vdsm/storage/hsm.py", line 1963, in _getDeviceList

pv = lvm.getPV(guid)

  File "/usr/share/vdsm/storage/lvm.py", line 853, in getPV

raise se.InaccessiblePhysDev((pvName,))

InaccessiblePhysDev: Multipath cannot access physical device(s): 
"devices=(u'320080013789309c0',)"



Thank you.


___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users