Re: [vdsm] VDSM test unit running path

2013-03-07 Thread Dan Kenigsberg
On Thu, Mar 07, 2013 at 02:18:35PM +0800, Shu Ming wrote:
 Hi,
 
 Now, The VDSM test unit is expected to run in a un-installed enviornment
 and use hackVDSM() to fake modules importing. hackVDSM() is pretty
 tricky for other modules to be added because of the dependency order. I
 would propose to run the VDSM unit tests in a installed VDSM path which
 is the same path as other VDSM runnable binaries. By this way, we can
 abandon hackVDSM() and run the unit test normally. On the other hand,
 the VDSM building script installs the VDSM files to home/builder by
 default, it is reasonable to start the VDSM unit test after all parts of
 the building script finishes. Any comments about this idea?

I prefer Vinzenz's take on a git repo reorganization.
http://gerrit.ovirt.org/#/c/11858/

There's an ongoing attempt to reach a consensus on that, though I must
admit we are a bit stuck.
___
vdsm-devel mailing list
vdsm-devel@lists.fedorahosted.org
https://lists.fedorahosted.org/mailman/listinfo/vdsm-devel


[vdsm] Proposal VDSM = Engine Data Statistics Retrieval Optimization

2013-03-07 Thread Vinzenz Feenstra
Please find the prettier version on the wiki: 
http://www.ovirt.org/Proposal_VDSM_-_Engine_Data_Statistics_Retrieval



 Proposal VDSM - Engine Data Statistics Retrieval


   VDSM = Engine data retrieval optimization


 Motivation:

Currently the RHEVM engine is polling the a lot of data from VDSM every 
15 seconds. This should be optimized and the amount of data requested 
should be more specific.


For each VM the data currently contains much more information than 
actually needed which blows up the size of the XML content quite big. We 
could optimize this by splitting the reply on the getVmStats based on 
the request of the engine into sections. For this reason Omer Frenkel 
and me have split up the data into parts based on their usage.


This data can and usually does change during the lifetime of the VM.


   Rarely Changed:

This data is change not very frequent and it should be enough to update 
this only once in a while. Most commonly this data changes after changes 
made in the UI or after a migration of the VM to another Host.


   *Status*  = Running
   *acpiEnable*  = true
   *vmType*  = kvm
   *guestName*  = W864GUESTAGENTT
   *displayType*  = qxl
   *guestOs*  = Win 8
   *kvmEnable*  = true #/*this should be constant and never changed*/
   *pauseCode*  = NOERR
   *monitorResponse*  = 0
   *session*  = Locked # unused
   *netIfaces*  = [{'name': 'Realtek RTL8139C+ Fast Ethernet NIC', 'inet6':  
['fe80::490c:92bb:bbcc:9f87'], 'inet': ['10.34.60.148'], 'hw': 
'00:1a:4a:22:3c:db'}]
   *appsList*  = ['RHEV-Tools 3.2.4', 'RHEV-Agent64 3.2.3', 'RHEV-Serial64 
3.2.3', 'RHEV-Network64 3.2.2', 'RHEV-Network64 3.2.3', 'RHEV-Block64 3.2.3', 
'RHEV-Balloon64 3.2.3', 'RHEV-Balloon64 3.2.2', 'RHEV-Agent64 3.2.2', 'RHEV-USB 
3.2.3', 'RHEV-Block64 3.2.2', 'RHEV-Serial64 3.2.2']
   *pid*  = 11314
   *guestIPs*  = 10.34.60.148 # duplicated info
   
   *displayIp*  = 0

   *displayPort*  = 5902
   *displaySecurePort*  = 5903
   
   *username*  = user@W864GUESTAGENTT

   *clientIp*  =
   *lastLogin*  = 1361976900.67


   Often Changed:

This data is changed quite often however it is not necessary to update 
this data every 15 seconds. As this is cumulative data and reflects the 
current status, and it does not need to be snapshotted every 15 seconds 
to retrieve statistics. The data can be retrieved in much more generous 
time slices. (e.g. Every 5 minutes)


   *network*  = {'vnet1': {'macAddr': '00:1a:4a:22:3c:db', 'rxDropped': '0', 
'txDropped': '0', 'rxErrors': '0', 'txRate': '0.0', 'rxRate': '0.0', 
'txErrors': '0', 'state': 'unknown', 'speed': '100', 'name': 'vnet1'}}
   *disksUsage*  = [{'path': 'c:\\', 'total': '64055406592', 'fs': 'NTFS', 
'used': '19223846912'}, {'path': 'd:\\', 'total': '3490912256', 'fs': 'UDF', 
'used': '3490912256'}]
   
   *timeOffset*  = 14422

   *elapsedTime*  = 68591
   *hash*  = 2335461227228498964
   *statsAge*  = 0.09 # unused


   Often Changed but unused

This data does not seem to be used in the engine at all. It is *not* 
even used in the data warehouse.


   *memoryStats*  = {'swap_out': '0', 'majflt': '0', 'mem_free': '1466884', 
'swap_in': '0', 'pageflt': '0', 'mem_total': '2096736', 'mem_unused': '1466884'}
   *balloonInfo*  = {'balloon_max': 2097152, 'balloon_cur': 2097152}
   
   *disks*  = {'vda': {'readLatency': '0', 'apparentsize': '64424509440', 'writeLatency': '1754496', 	'imageID': '28abb923-7b89-4638-84f8-1700f0b76482', 'flushLatency': '156549',  'readRate': '0.00', 'truesize': '18855059456', 'writeRate': '952.05'}, 'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}



   Very frequent uppdates needed by webadmin portal:

This data is mostly needed for the webadmin portal and might be required 
to be updated quite often. An exception here is the statsAge field, 
which seems to be unused by the Engine. This data could be requested 
every 15 seconds to keep things as they are now.


   *cpuSys*  = 2.32
   *cpuUser*  = 1.34
   *memUsage*  = 30


   Proposed Solution for VDSM  Engine:

We will introduce new optional parameters to getVmStats, getAllVmStats 
and list to allow a finer grained specification of data which should be 
included.


*Parameter:* *statsType*=/*string*/ (getVmStats, getAllVmStats only) 
*Allowed values:*


 * full (default to keep backwards compatibility)
 * app-list (Just send the application list)
 * rare (include everything from rarely changed to very frequent)
 * often (include everything from often changed to very frequent)
 * frequent (only send the very frequently changed items)


*Parameter:* *clientId*=*string* The client id is specified by the 
client and should be unique however constantly used.


*Parameter:* *diff*=*boolean* In combination with the clientId VDSM 
will send only differences to the previous request from the named 
clientId. (if diff=true)



 Additional Change:

Besides the introduction of 

Re: [vdsm] [JENKINS][ANN] jenkins.ovirt.org new look and infra

2013-03-07 Thread Eyal Edri


- Original Message -
 From: Karsten 'quaid' Wade kw...@redhat.com
 To: Eyal Edri ee...@redhat.com
 Cc: Itamar Heim ih...@redhat.com, us...@ovirt.org, engine-devel 
 engine-de...@ovirt.org,
 vdsm-devel@lists.fedorahosted.org, infra in...@ovirt.org
 Sent: Thursday, March 7, 2013 2:34:49 AM
 Subject: Re: [JENKINS][ANN] jenkins.ovirt.org new look and infra
 
 On 03/06/2013 01:43 PM, Eyal Edri wrote:
  
  
  - Original Message -
  From: Itamar Heim ih...@redhat.com
  can we shutdown the ec2 instance for now?
  
  not yet, me  quaid should change the dns 1st (tomorrow)?
  and then we can do it.
 
 If the host thinks it's already jenkins.ovirt.org, then we can just
 do
 the DNS switch soonest. Do we need to coordinate more closely on
 timing? Otherwise I can just file the ticket. (I'll wait for your
 word
 before picking a time.)

i think we're OK with moving it:
i changed all configuration files  hostname on alterway01 to be 
jenkins.ovirt.org,
so we just need to point jenkins.ovirt.org to alterway01.ovirt.org (ip) in dns 
i belive.

so go a head and open the ticket.

itamar, let's wait with deleting the vm until we're sure it's OK?

 
  do we have more horsepower to start running say engine findbugs on
  gerrit patches?
  
  not really, since we're still using the same ec2 slaves.
  (unless we'll run it on the master, but that's not recommended in
  terms of security)
  once we'll have ovirt instance running with vms, i imagine we can.
  hopefully we'll have it running soon (either on alterway02 or on
  the rackspace servers)
 
 I was supposed to be working RackSpace servers today, but I got
 caught
 up in being a bit sick and post-travel. But the plan is to load F18 +
 the oVirt all-in-one on rax01.
 
 - Karsten
 --
 Karsten 'quaid' Wade, Sr. Analyst - Community Growth
 http://TheOpenSourceWay.org  .^\  http://community.redhat.com
 @quaid (identi.ca/twitter/IRC)  \v'  gpg: AD0E0C41
 
 
___
vdsm-devel mailing list
vdsm-devel@lists.fedorahosted.org
https://lists.fedorahosted.org/mailman/listinfo/vdsm-devel


Re: [vdsm] [JENKINS][ANN] jenkins.ovirt.org new look and infra

2013-03-07 Thread Karsten 'quaid' Wade
On 03/07/2013 07:29 AM, Eyal Edri wrote:

 i think we're OK with moving it:
 i changed all configuration files  hostname on alterway01 to be 
 jenkins.ovirt.org,
 so we just need to point jenkins.ovirt.org to alterway01.ovirt.org (ip) in 
 dns i belive.

I just put in the CNAME request to have jenkins.ovirt.org point to
alterway01.ovirt.org, and told them to just do it  tell me when it's
done. I'll bounce the good word back to this list when I get it.

- Karsten
-- 
Karsten 'quaid' Wade, Sr. Analyst - Community Growth
http://TheOpenSourceWay.org  .^\  http://community.redhat.com
@quaid (identi.ca/twitter/IRC)  \v'  gpg: AD0E0C41



signature.asc
Description: OpenPGP digital signature
___
vdsm-devel mailing list
vdsm-devel@lists.fedorahosted.org
https://lists.fedorahosted.org/mailman/listinfo/vdsm-devel


Re: [vdsm] [Engine-devel] Proposal VDSM = Engine Data Statistics Retrieval Optimization

2013-03-07 Thread Dan Kenigsberg
On Thu, Mar 07, 2013 at 12:25:54PM +0100, Vinzenz Feenstra wrote:
 Please find the prettier version on the wiki:
 http://www.ovirt.org/Proposal_VDSM_-_Engine_Data_Statistics_Retrieval
 
 
  Proposal VDSM - Engine Data Statistics Retrieval
 
 
VDSM = Engine data retrieval optimization
 
 
  Motivation:
 
 Currently the RHEVM engine is polling the a lot of data from VDSM
 every 15 seconds. This should be optimized and the amount of data
 requested should be more specific.

It feels like a good idea, but do you have numbers? How much traffic
would be saved? Remember the added computation incurred on each host -
there's always a price to pay.

 
 For each VM the data currently contains much more information than
 actually needed which blows up the size of the XML content quite
 big. We could optimize this by splitting the reply on the getVmStats
 based on the request of the engine into sections. For this reason
 Omer Frenkel and me have split up the data into parts based on their
 usage.
 
 This data can and usually does change during the lifetime of the VM.
 
 
Rarely Changed:
 
 This data is change not very frequent and it should be enough to
 update this only once in a while. Most commonly this data changes
 after changes made in the UI or after a migration of the VM to
 another Host.
 
*Status*  = Running

Status does not change much, but when it does, it is important to report
that quickly.

*acpiEnable*  = true
*vmType*  = kvm
*guestName*  = W864GUESTAGENTT
*displayType*  = qxl
*guestOs*  = Win 8
*kvmEnable*  = true #/*this should be constant and never changed*/
*pauseCode*  = NOERR
*monitorResponse*  = 0
*session*  = Locked # unused
*netIfaces*  = [{'name': 'Realtek RTL8139C+ Fast Ethernet NIC', 'inet6':  
 ['fe80::490c:92bb:bbcc:9f87'], 'inet': ['10.34.60.148'], 'hw': 
 '00:1a:4a:22:3c:db'}]
*appsList*  = ['RHEV-Tools 3.2.4', 'RHEV-Agent64 3.2.3', 'RHEV-Serial64 
 3.2.3', 'RHEV-Network64 3.2.2', 'RHEV-Network64 3.2.3', 'RHEV-Block64 3.2.3', 
 'RHEV-Balloon64 3.2.3', 'RHEV-Balloon64 3.2.2', 'RHEV-Agent64 3.2.2', 
 'RHEV-USB 3.2.3', 'RHEV-Block64 3.2.2', 'RHEV-Serial64 3.2.2']
*pid*  = 11314
*guestIPs*  = 10.34.60.148 # duplicated info
*displayIp*  = 0
*displayPort*  = 5902
*displaySecurePort*  = 5903
*username*  = user@W864GUESTAGENTT
*clientIp*  =
*lastLogin*  = 1361976900.67
 
 
Often Changed:
 
 This data is changed quite often however it is not necessary to
 update this data every 15 seconds. As this is cumulative data and
 reflects the current status, and it does not need to be snapshotted
 every 15 seconds to retrieve statistics. The data can be retrieved
 in much more generous time slices. (e.g. Every 5 minutes)
 
*network*  = {'vnet1': {'macAddr': '00:1a:4a:22:3c:db', 'rxDropped': '0', 
 'txDropped': '0', 'rxErrors': '0', 'txRate': '0.0', 'rxRate': '0.0', 
 'txErrors': '0', 'state': 'unknown', 'speed': '100', 'name': 'vnet1'}}
*disksUsage*  = [{'path': 'c:\\', 'total': '64055406592', 'fs': 'NTFS', 
 'used': '19223846912'}, {'path': 'd:\\', 'total': '3490912256', 'fs': 'UDF', 
 'used': '3490912256'}]
*timeOffset*  = 14422
*elapsedTime*  = 68591
*hash*  = 2335461227228498964
*statsAge*  = 0.09 # unused
 
 
Often Changed but unused
 
 This data does not seem to be used in the engine at all. It is *not*
 even used in the data warehouse.
 
*memoryStats*  = {'swap_out': '0', 'majflt': '0', 'mem_free': '1466884', 
 'swap_in': '0', 'pageflt': '0', 'mem_total': '2096736', 'mem_unused': 
 '1466884'}
*balloonInfo*  = {'balloon_max': 2097152, 'balloon_cur': 2097152}
*disks*  = {'vda': {'readLatency': '0', 'apparentsize': '64424509440', 
 'writeLatency': '1754496',  'imageID': 
 '28abb923-7b89-4638-84f8-1700f0b76482', 'flushLatency': '156549',  
 'readRate': '0.00', 'truesize': '18855059456', 'writeRate': '952.05'}, 'hdc': 
 {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 
 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': 
 '0.00'}}

I am pretty sure that {read,write,flush}Latency is collected and
reported by Engine. `git grep writeLatency` reinforces my vague memory.
 
 
Very frequent uppdates needed by webadmin portal:
 
 This data is mostly needed for the webadmin portal and might be
 required to be updated quite often. An exception here is the
 statsAge field, which seems to be unused by the Engine. This data
 could be requested every 15 seconds to keep things as they are now.
 
*cpuSys*  = 2.32
*cpuUser*  = 1.34
*memUsage*  = 30
 
 
Proposed Solution for VDSM  Engine:
 
 We will introduce new optional parameters to getVmStats,
 getAllVmStats and list to allow a finer grained specification of
 data which should be included.
 
 *Parameter:* *statsType*=/*string*/ (getVmStats, getAllVmStats
 only) *Allowed values:*
 
  * full (default to keep backwards compatibility)
  * app-list (Just send the 

Re: [vdsm] Proposal VDSM = Engine Data Statistics Retrieval Optimization

2013-03-07 Thread Mark Wu

On 03/07/2013 07:25 PM, Vinzenz Feenstra wrote:
Please find the prettier version on the wiki: 
http://www.ovirt.org/Proposal_VDSM_-_Engine_Data_Statistics_Retrieval



  Proposal VDSM - Engine Data Statistics Retrieval


VDSM = Engine data retrieval optimization


  Motivation:

Currently the RHEVM engine is polling the a lot of data from VDSM 
every 15 seconds. This should be optimized and the amount of data 
requested should be more specific.


If the data size really matters,  we could also consider to pack the 
information into binary.  I am not sure if it's suitable in the 
transmission of  XMLRPC.


For each VM the data currently contains much more information than 
actually needed which blows up the size of the XML content quite big. 
We could optimize this by splitting the reply on the getVmStats based 
on the request of the engine into sections. For this reason Omer 
Frenkel and me have split up the data into parts based on their usage.


This data can and usually does change during the lifetime of the VM.


Rarely Changed:

This data is change not very frequent and it should be enough to 
update this only once in a while. Most commonly this data changes 
after changes made in the UI or after a migration of the VM to another 
Host.


*Status*  = Running
*acpiEnable*  = true
*vmType*  = kvm
*guestName*  = W864GUESTAGENTT
*displayType*  = qxl
*guestOs*  = Win 8
*kvmEnable*  = true #/*this should be constant and never changed*/
Then it should be removed from vm stats. In my opinion, any information 
belongs to vm's static configuration, it shouldn't be included in vm 
stats. For the fields above, except 'Status',  engine can get the 
information without querying the vdsm host. It could not be changed by 
vdsm itself, right?

*pauseCode*  = NOERR
*monitorResponse*  = 0
*session*  = Locked # unused
*netIfaces*  = [{'name': 'Realtek RTL8139C+ Fast Ethernet NIC', 'inet6':  
['fe80::490c:92bb:bbcc:9f87'], 'inet': ['10.34.60.148'], 'hw': 
'00:1a:4a:22:3c:db'}]
*appsList*  = ['RHEV-Tools 3.2.4', 'RHEV-Agent64 3.2.3', 'RHEV-Serial64 
3.2.3', 'RHEV-Network64 3.2.2', 'RHEV-Network64 3.2.3', 'RHEV-Block64 3.2.3', 
'RHEV-Balloon64 3.2.3', 'RHEV-Balloon64 3.2.2', 'RHEV-Agent64 3.2.2', 'RHEV-USB 
3.2.3', 'RHEV-Block64 3.2.2', 'RHEV-Serial64 3.2.2']
*pid*  = 11314
*guestIPs*  = 10.34.60.148 # duplicated info

*displayIp*  = 0

*displayPort*  = 5902
*displaySecurePort*  = 5903

*username*  = user@W864GUESTAGENTT

*clientIp*  =
*lastLogin*  = 1361976900.67


Often Changed:

This data is changed quite often however it is not necessary to update 
this data every 15 seconds. As this is cumulative data and reflects 
the current status, and it does not need to be snapshotted every 15 
seconds to retrieve statistics. The data can be retrieved in much more 
generous time slices. (e.g. Every 5 minutes)


*network*  = {'vnet1': {'macAddr': '00:1a:4a:22:3c:db', 'rxDropped': '0', 
'txDropped': '0', 'rxErrors': '0', 'txRate': '0.0', 'rxRate': '0.0', 
'txErrors': '0', 'state': 'unknown', 'speed': '100', 'name': 'vnet1'}}

macAddr and name don't change either.

*disksUsage*  = [{'path': 'c:\\', 'total': '64055406592', 'fs': 'NTFS', 
'used': '19223846912'}, {'path': 'd:\\', 'total': '3490912256', 'fs': 'UDF', 
'used': '3490912256'}]

*timeOffset*  = 14422

*elapsedTime*  = 68591
*hash*  = 2335461227228498964
*statsAge*  = 0.09 # unused


Often Changed but unused

This data does not seem to be used in the engine at all. It is *not* 
even used in the data warehouse.


*memoryStats*  = {'swap_out': '0', 'majflt': '0', 'mem_free': '1466884', 
'swap_in': '0', 'pageflt': '0', 'mem_total': '2096736', 'mem_unused': '1466884'}
*balloonInfo*  = {'balloon_max': 2097152, 'balloon_cur': 2097152}


It's used by mom to adjust memory overcommitment dynamically.

*disks*  = {'vda': {'readLatency': '0', 'apparentsize': '64424509440', 
'writeLatency': '1754496',   'imageID': '28abb923-7b89-4638-84f8-1700f0b76482', 
'flushLatency': '156549',  'readRate': '0.00', 'truesize': '18855059456', 
'writeRate': '952.05'}, 'hdc': {'readLatency': '0', 'apparentsize': '0', 
'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 
'writeRate': '0.00'}}


Very frequent uppdates needed by webadmin portal:

This data is mostly needed for the webadmin portal and might be 
required to be updated quite often. An exception here is the statsAge 
field, which seems to be unused by the Engine. This data could be 
requested every 15 seconds to keep things as they are now.


*cpuSys*  = 2.32
*cpuUser*  = 1.34
*memUsage*  = 30


Proposed Solution for VDSM  Engine:

We will introduce new optional parameters to getVmStats, getAllVmStats 
and list to allow a finer grained specification of data which should 
be included.


*Parameter:* *statsType*=/*string*/ (getVmStats, 

Re: [vdsm] [Engine-devel] Proposal VDSM = Engine Data Statistics Retrieval Optimization

2013-03-07 Thread Mark Wu

On 03/08/2013 06:11 AM, Dan Kenigsberg wrote:

On Thu, Mar 07, 2013 at 12:25:54PM +0100, Vinzenz Feenstra wrote:

Please find the prettier version on the wiki:
http://www.ovirt.org/Proposal_VDSM_-_Engine_Data_Statistics_Retrieval


  Proposal VDSM - Engine Data Statistics Retrieval


VDSM = Engine data retrieval optimization


  Motivation:

Currently the RHEVM engine is polling the a lot of data from VDSM
every 15 seconds. This should be optimized and the amount of data
requested should be more specific.

It feels like a good idea, but do you have numbers? How much traffic
would be saved? Remember the added computation incurred on each host -
there's always a price to pay.


For each VM the data currently contains much more information than
actually needed which blows up the size of the XML content quite
big. We could optimize this by splitting the reply on the getVmStats
based on the request of the engine into sections. For this reason
Omer Frenkel and me have split up the data into parts based on their
usage.

This data can and usually does change during the lifetime of the VM.


Rarely Changed:

This data is change not very frequent and it should be enough to
update this only once in a while. Most commonly this data changes
after changes made in the UI or after a migration of the VM to
another Host.

*Status*  = Running

Status does not change much, but when it does, it is important to report
that quickly.
For this kind of data, it is suitable to use an event report, which 
should be available in the jsonrpc API.



*acpiEnable*  = true
*vmType*  = kvm
*guestName*  = W864GUESTAGENTT
*displayType*  = qxl
*guestOs*  = Win 8
*kvmEnable*  = true #/*this should be constant and never changed*/
*pauseCode*  = NOERR
*monitorResponse*  = 0
*session*  = Locked # unused
*netIfaces*  = [{'name': 'Realtek RTL8139C+ Fast Ethernet NIC', 'inet6':  
['fe80::490c:92bb:bbcc:9f87'], 'inet': ['10.34.60.148'], 'hw': 
'00:1a:4a:22:3c:db'}]
*appsList*  = ['RHEV-Tools 3.2.4', 'RHEV-Agent64 3.2.3', 'RHEV-Serial64 
3.2.3', 'RHEV-Network64 3.2.2', 'RHEV-Network64 3.2.3', 'RHEV-Block64 3.2.3', 
'RHEV-Balloon64 3.2.3', 'RHEV-Balloon64 3.2.2', 'RHEV-Agent64 3.2.2', 'RHEV-USB 
3.2.3', 'RHEV-Block64 3.2.2', 'RHEV-Serial64 3.2.2']
*pid*  = 11314
*guestIPs*  = 10.34.60.148 # duplicated info
*displayIp*  = 0
*displayPort*  = 5902
*displaySecurePort*  = 5903
*username*  = user@W864GUESTAGENTT
*clientIp*  =
*lastLogin*  = 1361976900.67


Often Changed:

This data is changed quite often however it is not necessary to
update this data every 15 seconds. As this is cumulative data and
reflects the current status, and it does not need to be snapshotted
every 15 seconds to retrieve statistics. The data can be retrieved
in much more generous time slices. (e.g. Every 5 minutes)

*network*  = {'vnet1': {'macAddr': '00:1a:4a:22:3c:db', 'rxDropped': '0', 
'txDropped': '0', 'rxErrors': '0', 'txRate': '0.0', 'rxRate': '0.0', 
'txErrors': '0', 'state': 'unknown', 'speed': '100', 'name': 'vnet1'}}
*disksUsage*  = [{'path': 'c:\\', 'total': '64055406592', 'fs': 'NTFS', 
'used': '19223846912'}, {'path': 'd:\\', 'total': '3490912256', 'fs': 'UDF', 
'used': '3490912256'}]
*timeOffset*  = 14422
*elapsedTime*  = 68591
*hash*  = 2335461227228498964
*statsAge*  = 0.09 # unused


Often Changed but unused

This data does not seem to be used in the engine at all. It is *not*
even used in the data warehouse.

*memoryStats*  = {'swap_out': '0', 'majflt': '0', 'mem_free': '1466884', 
'swap_in': '0', 'pageflt': '0', 'mem_total': '2096736', 'mem_unused': '1466884'}
*balloonInfo*  = {'balloon_max': 2097152, 'balloon_cur': 2097152}
*disks*  = {'vda': {'readLatency': '0', 'apparentsize': '64424509440', 
'writeLatency': '1754496',   'imageID': '28abb923-7b89-4638-84f8-1700f0b76482', 
'flushLatency': '156549',  'readRate': '0.00', 'truesize': '18855059456', 
'writeRate': '952.05'}, 'hdc': {'readLatency': '0', 'apparentsize': '0', 
'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 
'writeRate': '0.00'}}

I am pretty sure that {read,write,flush}Latency is collected and
reported by Engine. `git grep writeLatency` reinforces my vague memory.


Very frequent uppdates needed by webadmin portal:

This data is mostly needed for the webadmin portal and might be
required to be updated quite often. An exception here is the
statsAge field, which seems to be unused by the Engine. This data
could be requested every 15 seconds to keep things as they are now.

*cpuSys*  = 2.32
*cpuUser*  = 1.34
*memUsage*  = 30


Proposed Solution for VDSM  Engine:

We will introduce new optional parameters to getVmStats,
getAllVmStats and list to allow a finer grained specification of
data which should be included.

*Parameter:* *statsType*=/*string*/ (getVmStats, getAllVmStats
only) *Allowed values:*

  *