[ovirt-users] Re: data flow for statistics for hosts and vms

2018-05-18 Thread Peter Hudec 
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA512

Hi Shirly,

I know about the grafana integration with the DWH.

I know about oVirt Metrics, I saw the video with you presenting this
product and read the docs. I also tried to install the Metrics store.
You could find some mail in in this mailing list about that. I was not
able to run it successfully. You were included in that communication.
I could try it again, but this is too big for or needs ;(

The basic idea is to integrate it into zabbix, which is our primary
monitoring system for whole datacenter, infrastructure, VmWare, .. I
do not want to add new screen for our NOC to watch on.

Generally I was interested in data flow how the data are collected
from HOSTS to ENGINE database.

The flow for metrics I guess is

libirt or vdsm(host) <- collectd (host) -> log files?? (host) <-
fluend (host) -> elk (metrics).

This is really nice example how to glue the components together. ;)



On 16/05/2018 11:04, Shirly Radco wrote:
> Hi Peter,
> 
> The dwh views do not change, we support legacy views fro 3.6,  so
> we recommend using DWH to get the statistics you want. It is
> possible to connect grafana directly with DWH if that interest
> you.
> 
> Also, We have a new feature called "oVirt metrics store" that
> collectd many statistics using and logs using fluentd to a central
> Elasticsearch and Kibana. I can elaborate on that if you want.
> 
> Best,
> 
> --
> 
> SHIRLY RADCO
> 
> BI SeNIOR SOFTWARE ENGINEER
> 
> Red Hat Israel 
> 
>  TRIED. TESTED. TRUSTED.
> 
> 
> 
> On Tue, May 15, 2018 at 4:23 PM, Peter Hudec  > wrote:
> 
> Hi,
> 
> I'm trying to understand the flow how the stats from the VM and
> HOSTS are imported  into the engine.
> 
> On each host there is VDSM. Using the vsdm-client I'm able to get
> HOST and VM stats
> 
> vdsm-client Host getAllVmStats vdsm-client Host getStats
> 
> Are the hosts pushing the data to the engine or vice versa? On the 
> engine side there is java based vdsm-jsonrpc client so I guess the 
> data are pulled from the hosts to the engine database.
> 
> 
>> Yes. Engine pulls the stats from the hosts every 15 seconds.
> 
> 
> And of course the question is which component on engine side is 
> getting/requesting the data.
> 
> I'm trying to get the stat less painless as query the API. Maybe
> the engine/dwh database could help but the scheme could change 
> between releases, isn't it. or the engine DB.
> 
> regards Peter
> 
> ___ Users mailing list
> -- users@ovirt.org  To unsubscribe send an
> email to users-le...@ovirt.org 
> 
> 

- -- 
*Peter Hudec*
Infraštruktúrny architekt
phu...@cnc.sk 

*CNC, a.s.*
Borská 6, 841 04 Bratislava
Recepcia: +421 2  35 000 100

Mobil:+421 905 997 203
*www.cnc.sk* 

-BEGIN PGP SIGNATURE-

iQIzBAEBCgAdFiEERCwM7E/ZOYb1ejhCbZu8qDuIhFsFAlr+xwQACgkQbZu8qDuI
hFu8jw//cB+3lf+MolpOR4oyDLr+GXvSXkv91ZtL85RVobX3mf/Zbd0VQuJkSr2w
sS0VSUK4PRASHUOGjNrMz6AByvZF1P7fdG23rXnJkWdM5xu09FJphIWsjfXqwdSM
PxAcxZZQv+wKgoXKjnHnGcbb8VdAkZSlHwH0egycwXpzIfvDFPrc7DeVwndC6Ibz
yIwUdpTyzm+KZ9EqTjdx0qb7AgYihtJXC7GWntEuook/ZOYrsN6dOoQ46KgzznXw
FhPWzMSrdl73wzXyqmvjSQo0PoXuNzXLSNqXyGTQuJTg8yYaiPkREo8LFj4SX7bB
Uc3s5/NGCiEr1+tEyk6tSeVM3cdIimN0O8kE3QFpIv6R6RjFC+K7WNkGBWxlc05S
CDCkpU921o6oTvd0bd9F3XT5TRVuME48yYuLvcT6GY8g837tkSinNLTZvYpr8yq7
iEm4500mF2cSBUhPYtgcxVfZ+0SeMoDdsbLqjM19voHGP8DvtMXOOUoFee/qwiJJ
2Kcjnid32db4EEdInwphFiAryhTy/GC6LB/6KunNqVXq5C/1FIyAi7UiceZO7YwU
r/RqxMvSkgW/rdMyBuPZ+3GP72l4yTOdm7cwcfplDDgWL67C5uyii7zG+ApTUmre
wuz86ECe/QIWAvw/hoTmu4WXxGxT6ErUzfjh1/v4Kfx+/S+V3WI=
=/KT/
-END PGP SIGNATURE-
___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org

[ovirt-users] Re: data flow for statistics for hosts and vms

2018-05-16 Thread Shirly Radco 
Hi Peter,

The dwh views do not change, we support legacy views fro 3.6,  so we
recommend using DWH to get the statistics you want.
It is possible to connect grafana directly with DWH if that interest you.

Also, We have a new feature called "oVirt metrics store" that collectd many
statistics using and logs using fluentd to a central Elasticsearch and
Kibana.
I can elaborate on that if you want.

Best,

--

SHIRLY RADCO

BI SeNIOR SOFTWARE ENGINEER

Red Hat Israel 

TRIED. TESTED. TRUSTED. 

On Tue, May 15, 2018 at 4:23 PM, Peter Hudec  wrote:

> -BEGIN PGP SIGNED MESSAGE-
> Hash: SHA512
>
> Hi,
>
> I'm trying to understand the flow how the stats from the VM and HOSTS
> are imported  into the engine.
>
> On each host there is VDSM. Using the vsdm-client I'm able to get HOST
> and VM stats
>
> vdsm-client Host getAllVmStats
> vdsm-client Host getStats
>
> Are the hosts pushing the data to the engine or vice versa? On the
> engine side there is java based vdsm-jsonrpc client so I guess the
> data are pulled from the hosts to the engine database.
>
>
Yes. Engine pulls the stats from the hosts every 15 seconds.


> And of course the question is which component on engine side is
> getting/requesting the data.
>
> I'm trying to get the stat less painless as query the API.
> Maybe the engine/dwh database could help but the scheme could change
> between releases, isn't it. or the engine DB.
>
> regards
> Peter
>
> - --
> *Peter Hudec*
> Infraštruktúrny architekt
> phu...@cnc.sk 
>
> *CNC, a.s.*
> Borská 6, 841 04 Bratislava
> Recepcia: +421 2  35 000 100
>
> Mobil:+421 905 997 203
> *www.cnc.sk* 
>
> -BEGIN PGP SIGNATURE-
>
> iQIzBAEBCgAdFiEEqSUbhuEwhryifNeVQnvVWOJ35BAFAlr63zYACgkQQnvVWOJ3
> 5BC1BxAApSg29lv1KohiVeJNsFdF4i77e2H77drLe9Ffq1kg/+VESh6+ggeZIH1U
> W5e06PJeifoZbtWL2enaJsml9JZM/3kvqU5TC93sR8chvhfRo3GXS50tWCEe5b0R
> UPdpjgyYipN+i3Xibl/YxHMu9fwpFIH+VY+JWn70Dz5pjvgwn71ogCcRUA6Itvom
> 700Pwv4yV31hWyE6qXiWOth0Rfey3+QkEXtNhRrEOHeAzpNABS5Zixjocr9c5xhz
> AdLkUAGVvEQEYy/Nzyv8A8KRSY1z63Ijyv5hgQIpGkKfbXhRYrotY6EeqdJ6PYsF
> tQvkjjT+kJ5SBYClK/et9X4y2ZMe+4YX7lrsZnk8V/Oj3YYw2y1XlvXcrt0pZlHA
> G9QIhcn/chtBTslGOW0t4B603YRykausunc9XXq1IGKNyLHb/lrDiDh+x2dCg5vT
> sGJE/gQffSNSwk5oFBlG2U9aOgWvZ8m3nVCDdGo+1a9fc/KR8toQi9axsiIMVYb/
> dzbDmaYlXbKNwWdVirftTetxuwn44j2Kgv4b048ZmGwTvwc79UuoS8H9hv9LlBM6
> 7E7iqaGfKbExg0/EMZurd90P62zn8nIGnYEJUrxVU3aJ4E2gWflfSelYMymNtE+u
> aZAMxvK6gILQP2n45AVkKOTacQwX07QCzlvJ2sL4gNzQQ+UL52c=
> =RNAH
> -END PGP SIGNATURE-
> ___
> Users mailing list -- users@ovirt.org
> To unsubscribe send an email to users-le...@ovirt.org
>
___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org