[ovirt-users] GlusterFS and oVirt
Hello I have quite some trouble getting Gluster to work. I have 4 nodes running CentOS and oVirt. These 4 nodes is split up in 2 clusters. I do not run Gluster via oVirt, i run it stand alone to be able to use all 4 nodes into one gluster volume. I can add all peers successfully, and i can create an volume and start it with sucess, but after that it starts to getting troublesome. If i run gluster volume status after starting the volume it times out, i have read that ping-time needs to bee more than 0 so i set it on 30, Still the same problem. >From now on, i can not stop a volume nor remove it, i have to stop glusterd >and remove it from /var/lib/gluster/vols/* on all nodes to be able to do >anything with gluster. >From time to time when i do a gluster peer status it shows "disconnected" and >when i run it again directly after it show "connected" I get a lot of these errors in glusterd.log [2019-01-20 12:53:46.087848] W [rpc-clnt-ping.c:223:rpc_clnt_ping_cbk] 0-management: socket disconnected [2019-01-20 12:53:46.087858] W [rpc-clnt-ping.c:246:rpc_clnt_ping_cbk] 0-management: RPC_CLNT_PING notify failed [2019-01-20 12:53:55.091598] W [rpc-clnt-ping.c:246:rpc_clnt_ping_cbk] 0-management: RPC_CLNT_PING notify failed [2019-01-20 12:53:56.094846] W [rpc-clnt-ping.c:246:rpc_clnt_ping_cbk] 0-management: RPC_CLNT_PING notify failed [2019-01-20 12:53:56.097482] W [rpc-clnt-ping.c:246:rpc_clnt_ping_cbk] 0-management: RPC_CLNT_PING notify failed What am i doing wrong? //Magnus ___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/6XHSOBCDZ6AG4AVC4MLQNRJUJ2NKYTI2/
Re: [Users] GlusterFS on oVirt node
Progress report: I remounted fs on oVirt nodes rw, started glusterd with no errors. Then I activated hosts in oVirt Engine. Also no errors! Yei! Then I created volume (replication), added two bricks (oVirt nodes), and started volume. Seems fine. I checkd on node1: # gluster volume info Volume Name: data_vol Type: Replicate Volume ID: a1cdc762-2198-47e2-9b4a-58fd0571b269 Status: Started Number of Bricks: 1 x 2 = 2 Transport-type: tcp Bricks: Brick1: 192.168.254.124:/data/gluster Brick2: 192.168.254.141:/data/gluster Options Reconfigured: storage.owner-gid: 36 storage.owner-uid: 36 auth.allow: * user.cifs: on nfs.disable: off WORKING! BUT... Now i can not create storage domain. When I hit OK button on New storage domain dialog, process is running very long. Eventually this process stops and returns Error while executing action Add Storage Connection: Network error during communication with the Host. I'm stuck again :-( in need for HELP! tnx Dne 24. 10. 2013 13:02, piše Mike Burns: Adding to node-devel list and users list. -- Mike Apologies for top posting and typos. This was sent from a mobile device. Saša Friedrich sasa.friedr...@bitlab.si wrote: Hello! Acording to http://www.ovirt.org/Node_Glusterfs_Support glusterfs on ovirt node should be supported. But I have some difficulties to implement it. I installed ovirt (nested kvm - home testing) following Up and Running with oVirt 3.3) using Fedora19 Install went well. Everything is working fine. Now I created two hosts (nested kvm - ovirt node fc19 - just for testing) and added them in oVirt. Super fine - working! Now I'd like to use this hosts as glustefs nodes too. Acording to google (I'm googling for two days now) I'ts possible, but I can not find any usable how-to 1. I removed these two hosts from default data center 2. I created new data center (type: GlusterFS) 3. I created new cluster (Enable Gluster Service checked) 4. I added host 5. Now I get error message in events: Could not find gluster uuid of server host1 on Cluster Cluster1. If I ssh to my host (fc19 node) glusterd.service is not running. If I try to run it It returns error here is the log: [2013-10-24 09:52:25.969899] I [glusterfsd.c:1910:main] 0-/usr/sbin/glusterd: Started running /usr/sbin/glusterd version 3.4.0 (/usr/sbin/glusterd -p /run/glusterd.pid) [2013-10-24 09:52:25.974480] I [glusterd.c:962:init] 0-management: Using /var/lib/glusterd as working directory [2013-10-24 09:52:25.977648] I [socket.c:3480:socket_init] 0-socket.management: SSL support is NOT enabled [2013-10-24 09:52:25.977694] I [socket.c:3495:socket_init] 0-socket.management: using system polling thread [2013-10-24 09:52:25.978611] W [rdma.c:4197:__gf_rdma_ctx_create] 0-rpc-transport/rdma: rdma_cm event channel creation failed (No such device) [2013-10-24 09:52:25.978651] E [rdma.c:4485:init] 0-rdma.management: Failed to initialize IB Device [2013-10-24 09:52:25.978667] E [rpc-transport.c:320:rpc_transport_load] 0-rpc-transport: 'rdma' initialization failed [2013-10-24 09:52:25.978747] W [rpcsvc.c:1387:rpcsvc_transport_create] 0-rpc-service: cannot create listener, initing the transport failed [2013-10-24 09:52:25.979890] I [glusterd.c:354:glusterd_check_gsync_present] 0-glusterd: geo-replication module not installed in the system [2013-10-24 09:52:25.98] E [store.c:394:gf_store_handle_retrieve] 0-: Unable to retrieve store handle /var/lib/glusterd/glusterd.info, error: No such file or directory [2013-10-24 09:52:25.980026] E [glusterd-store.c:1277:glusterd_retrieve_op_version] 0-: Unable to get store handle! [2013-10-24 09:52:25.980048] E [store.c:394:gf_store_handle_retrieve] 0-: Unable to retrieve store handle /var/lib/glusterd/glusterd.info, error: No such file or directory [2013-10-24 09:52:25.980060] E [glusterd-store.c:1378:glusterd_retrieve_uuid] 0-: Unable to get store handle! [2013-10-24 09:52:25.980074] I [glusterd-store.c:1348:glusterd_restore_op_version] 0-management: Detected new install. Setting op-version to maximum : 2 [2013-10-24 09:52:25.980309] E [store.c:360:gf_store_handle_new] 0-: Failed to open file: /var/lib/glusterd/options, error: Read-only file system Acording to log /var/lib/glusterd/glusterd.info is missing and can not be created because fs is mounted ro. Now I'm stuck! What am I missing? tnx for help! ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [Users] GlusterFS on oVirt node
Adding to node-devel list and users list. -- Mike Apologies for top posting and typos. This was sent from a mobile device. Saša Friedrich sasa.friedr...@bitlab.si wrote: Hello! Acording to http://www.ovirt.org/Node_Glusterfs_Support glusterfs on ovirt node should be supported. But I have some difficulties to implement it. I installed ovirt (nested kvm - home testing) following Up and Running with oVirt 3.3) using Fedora19 Install went well. Everything is working fine. Now I created two hosts (nested kvm - ovirt node fc19 - just for testing) and added them in oVirt. Super fine - working! Now I'd like to use this hosts as glustefs nodes too. Acording to google (I'm googling for two days now) I'ts possible, but I can not find any usable how-to 1. I removed these two hosts from default data center 2. I created new data center (type: GlusterFS) 3. I created new cluster (Enable Gluster Service checked) 4. I added host 5. Now I get error message in events: Could not find gluster uuid of server host1 on Cluster Cluster1. If I ssh to my host (fc19 node) glusterd.service is not running. If I try to run it It returns error here is the log: [2013-10-24 09:52:25.969899] I [glusterfsd.c:1910:main] 0-/usr/sbin/glusterd: Started running /usr/sbin/glusterd version 3.4.0 (/usr/sbin/glusterd -p /run/glusterd.pid) [2013-10-24 09:52:25.974480] I [glusterd.c:962:init] 0-management: Using /var/lib/glusterd as working directory [2013-10-24 09:52:25.977648] I [socket.c:3480:socket_init] 0-socket.management: SSL support is NOT enabled [2013-10-24 09:52:25.977694] I [socket.c:3495:socket_init] 0-socket.management: using system polling thread [2013-10-24 09:52:25.978611] W [rdma.c:4197:__gf_rdma_ctx_create] 0-rpc-transport/rdma: rdma_cm event channel creation failed (No such device) [2013-10-24 09:52:25.978651] E [rdma.c:4485:init] 0-rdma.management: Failed to initialize IB Device [2013-10-24 09:52:25.978667] E [rpc-transport.c:320:rpc_transport_load] 0-rpc-transport: 'rdma' initialization failed [2013-10-24 09:52:25.978747] W [rpcsvc.c:1387:rpcsvc_transport_create] 0-rpc-service: cannot create listener, initing the transport failed [2013-10-24 09:52:25.979890] I [glusterd.c:354:glusterd_check_gsync_present] 0-glusterd: geo-replication module not installed in the system [2013-10-24 09:52:25.98] E [store.c:394:gf_store_handle_retrieve] 0-: Unable to retrieve store handle /var/lib/glusterd/glusterd.info, error: No such file or directory [2013-10-24 09:52:25.980026] E [glusterd-store.c:1277:glusterd_retrieve_op_version] 0-: Unable to get store handle! [2013-10-24 09:52:25.980048] E [store.c:394:gf_store_handle_retrieve] 0-: Unable to retrieve store handle /var/lib/glusterd/glusterd.info, error: No such file or directory [2013-10-24 09:52:25.980060] E [glusterd-store.c:1378:glusterd_retrieve_uuid] 0-: Unable to get store handle! [2013-10-24 09:52:25.980074] I [glusterd-store.c:1348:glusterd_restore_op_version] 0-management: Detected new install. Setting op-version to maximum : 2 [2013-10-24 09:52:25.980309] E [store.c:360:gf_store_handle_new] 0-: Failed to open file: /var/lib/glusterd/options, error: Read-only file system Acording to log /var/lib/glusterd/glusterd.info is missing and can not be created because fs is mounted ro. Now I'm stuck! What am I missing? tnx for help! ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [Users] glusterfs and ovirt
Simple thing to try. Create a URL something like nfs.glusterfs.example.com and add a host entry on each system pointing to the ip of the system. Not 127.0.0.1 but the IP other stations would use to talk to the system. That would point every system to there local client. Thanks Robert On 3/1/2012 6:48 AM, ?? wrote: Hi. Test the ability to work as a storage server glusterfs. Direct support to glusterf ovirt unfortunately not. This feature will be added in the future? Attempted to implement a scheme of work - glusterfs mounted on a node in a folder mount glusterfs connected via NFS to ovirt. It works =) Now try to mount NFS to 127.0.0.1 and encountered an error: Command: [root@noc-4-m77 ~] # / bin / mount-o soft, timeo = 600, retrans = 6, nosharecache, vers = 3 -t nfs 127.0.0.1 :/share/tmp /tmpgcOezk Error: mount.nfs: Unknown error 521 NFS V4 is disabled. In this mount: /bin/mount -t nfs 127.0.0.1:/share/ tmp/tmpgtsoetsk is successful. I understand that this is not a problem ovirt, but you might prompt any ideas how to fix it? To use glusterfs in overt to execute a commandL Mount -t glusterfs -o log-level = WARNING, log-file = /var/log/gluster.log noc-1 :/mht / /share I can prescribe it in vdsm that it was carried out instead of /bin/mount-o soft, timeo = 600, retrans = 6, nosharecache, vers = 3 -t nfs 127.0.0.1:/share/tmp/tmpgtsOetsk ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [Users] glusterfs and ovirt
On 05/17/2012 06:55 PM, Bharata B Rao wrote: On Wed, May 16, 2012 at 3:29 PM, Itamar Heimih...@redhat.com wrote: On 05/15/2012 07:35 PM, Andrei Vakhnin wrote: Yair Thanks for an update. Can I have KVM hypervisors also function as storage nodes for glusterfs? What is a release date for glusterfs support? We're looking for a production deployment in June. Thanks current status is 1. patches for provisioning gluster clusters and volumes via ovirt are in review, trying to cover this feature set [1]. I'm not sure if all of them will make the ovirt 3.1 version which is slated to branch for stabilization June 1st, but i think enough is there. so i'd start trying current upstream version to help find issues blocking you, and following on them during june as we stabilize ovirt 3.1 for release (planned for end of june). 2. you should be able to use same hosts for both gluster and virt, but there is no special logic/handling for this yet (i.e., trying and providing feedback would help improve this mode). I would suggest start from separate clusters though first, and only later trying the joint mode. 3. creating a storage domain on top of gluster: - expose NFS on top of it, and consume as a normal nfs storage domain - use posixfs storage domain with gluster mount semantics - future: probably native gluster storage domain, up to native integration with qemu I am looking at GlusterFS integration with QEMU which involves adding GlusterFS as block backend in QEMU. This will involve QEMU talking to gluster directly via libglusterfs bypassing FUSE. I could specify a volume file and the VM image directly on QEMU command line to boot from the VM image that resides on a gluster volume. Eg: qemu -drive file=client.vol:/Fedora.img,format=gluster In this example, Fedora.img is being served by gluster and client.vol would have client-side translators specified. I am not sure if this use case would be served if GlusterFS is integrated as posixfs storage domain in VDSM. Posixfs would involve normal FUSE mount and QEMU would be required to work with images from FUSE mount path ? With QEMU supporting GlusterFS backend natively, further optimizations are possible in case of gluster volume being local to the host node. In this case, one could provide QEMU with a simple volume file that would not contain client or server xlators, but instead just the posix xlator. This would lead to most optimal IO path that bypasses RPC calls. So do you think, this use case (QEMU supporting GlusterFS backend natively and using volume file to specify the needed translators) warrants a specialized storage domain type for GlusterFS in VDSM ? I'm not sure if a special storage domain, or a PosixFS based domain with enhanced capabilities. Ayal? ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [Users] glusterfs and ovirt
On 5/17/2012 1:35 PM, Itamar Heim wrote: On 05/17/2012 06:55 PM, Bharata B Rao wrote: On Wed, May 16, 2012 at 3:29 PM, Itamar Heimih...@redhat.com wrote: On 05/15/2012 07:35 PM, Andrei Vakhnin wrote: Yair Thanks for an update. Can I have KVM hypervisors also function as storage nodes for glusterfs? What is a release date for glusterfs support? We're looking for a production deployment in June. Thanks current status is 1. patches for provisioning gluster clusters and volumes via ovirt are in review, trying to cover this feature set [1]. I'm not sure if all of them will make the ovirt 3.1 version which is slated to branch for stabilization June 1st, but i think enough is there. so i'd start trying current upstream version to help find issues blocking you, and following on them during june as we stabilize ovirt 3.1 for release (planned for end of june). 2. you should be able to use same hosts for both gluster and virt, but there is no special logic/handling for this yet (i.e., trying and providing feedback would help improve this mode). I would suggest start from separate clusters though first, and only later trying the joint mode. 3. creating a storage domain on top of gluster: - expose NFS on top of it, and consume as a normal nfs storage domain - use posixfs storage domain with gluster mount semantics - future: probably native gluster storage domain, up to native integration with qemu I am looking at GlusterFS integration with QEMU which involves adding GlusterFS as block backend in QEMU. This will involve QEMU talking to gluster directly via libglusterfs bypassing FUSE. I could specify a volume file and the VM image directly on QEMU command line to boot from the VM image that resides on a gluster volume. Eg: qemu -drive file=client.vol:/Fedora.img,format=gluster In this example, Fedora.img is being served by gluster and client.vol would have client-side translators specified. I am not sure if this use case would be served if GlusterFS is integrated as posixfs storage domain in VDSM. Posixfs would involve normal FUSE mount and QEMU would be required to work with images from FUSE mount path ? With QEMU supporting GlusterFS backend natively, further optimizations are possible in case of gluster volume being local to the host node. In this case, one could provide QEMU with a simple volume file that would not contain client or server xlators, but instead just the posix xlator. This would lead to most optimal IO path that bypasses RPC calls. So do you think, this use case (QEMU supporting GlusterFS backend natively and using volume file to specify the needed translators) warrants a specialized storage domain type for GlusterFS in VDSM ? I'm not sure if a special storage domain, or a PosixFS based domain with enhanced capabilities. Ayal? Direct qemu support for gluster is similar to ceph rbd/rados object storage which is also supported in qemu. A domain type which can handle object based storage of this sort would be very nice. ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [Users] glusterfs and ovirt
On 05/15/2012 07:35 PM, Andrei Vakhnin wrote: Yair Thanks for an update. Can I have KVM hypervisors also function as storage nodes for glusterfs? What is a release date for glusterfs support? We're looking for a production deployment in June. Thanks current status is 1. patches for provisioning gluster clusters and volumes via ovirt are in review, trying to cover this feature set [1]. I'm not sure if all of them will make the ovirt 3.1 version which is slated to branch for stabilization June 1st, but i think enough is there. so i'd start trying current upstream version to help find issues blocking you, and following on them during june as we stabilize ovirt 3.1 for release (planned for end of june). 2. you should be able to use same hosts for both gluster and virt, but there is no special logic/handling for this yet (i.e., trying and providing feedback would help improve this mode). I would suggest start from separate clusters though first, and only later trying the joint mode. 3. creating a storage domain on top of gluster: - expose NFS on top of it, and consume as a normal nfs storage domain - use posixfs storage domain with gluster mount semantics - future: probably native gluster storage domain, up to native integration with qemu can you please describe the use case you are trying to accommodate? thanks, Itamar [1] http://ovirt.org/wiki/Features/Gluster_Support Andrei On Apr 10, 2012, at 7:18 AM, Yair Zaslavsky wrote: On 04/10/2012 01:43 PM, Itamar Heim wrote: On 04/05/2012 05:25 PM, зоррыч wrote: Already know the date when it is added support for glusterfs? I can work with the test in a test version of glusterfs? there are two parts to the support: 1. managing the gluster hosts/storage/volumes - patches for different parts of this in gerrit - but not needed for first phase of using this. 2. using gluster as a posix fs - vdsm side is ready, and iirc, engine done by laszlo who can share when test patches can be used for testing this Small correction - patches are not at gerrit (referring to Posix FS at engine side) 3. integrating both together - a bit later :) -Original Message- From: Itamar Heim [mailto:ih...@redhat.com] Sent: Friday, March 02, 2012 4:10 AM To: зоррыч Cc: users@ovirt.org Subject: Re: [Users] glusterfs and ovirt On 03/01/2012 08:36 PM, зоррыч wrote: Good news. It already works in a test version or development has not yet begun? early patches to build this support are sent now to engine/vdsm. so work has begun, but not working yet -Original Message- From: Itamar Heim [mailto:ih...@redhat.com] Sent: Thursday, March 01, 2012 7:44 PM To: ?? Cc: users@ovirt.org Subject: Re: [Users] glusterfs and ovirt On 03/01/2012 01:48 PM, ?? wrote: Hi. Test the ability to work as a storage server glusterfs. Direct support to glusterf ovirt unfortunately not. This feature will be added in the future? I'll let someone else reply on the below, but as for ovirt-gluster integration - yes, it is in the works. this gives a general picture of the work being carried out: http://www.ovirt.org/wiki/AddingGlusterSupportToOvirt Attempted to implement a scheme of work -glusterfs mounted on a node in a folder mount glusterfs connected via NFS to ovirt. It works =) Now try to mount NFS to 127.0.0.1 and encountered an error: Command: [root@noc-4-m77 ~] # / bin / mount-o soft, timeo = 600, retrans = 6, nosharecache, vers = 3 -t nfs 127.0.0.1 :/share/tmp /tmpgcOezk Error: mount.nfs: Unknown error 521 NFS V4 is disabled. In this mount: /bin/mount -t nfs 127.0.0.1:/share/ tmp/tmpgtsoetsk is successful. I understand that this is not a problem ovirt, but you might prompt any ideas how to fix it? To use glusterfs in overt to execute a commandL Mount -t glusterfs -o log-level = WARNING, log-file = /var/log/gluster.log noc-1 :/mht / /share I can prescribe it in vdsm that it was carried out instead of /bin/mount-o soft, timeo = 600, retrans = 6, nosharecache, vers = 3 -t nfs 127.0.0.1:/share/tmp/tmpgtsOetsk ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [Users] glusterfs and ovirt
Yair Thanks for an update. Can I have KVM hypervisors also function as storage nodes for glusterfs? What is a release date for glusterfs support? We're looking for a production deployment in June. Thanks Andrei On Apr 10, 2012, at 7:18 AM, Yair Zaslavsky wrote: On 04/10/2012 01:43 PM, Itamar Heim wrote: On 04/05/2012 05:25 PM, зоррыч wrote: Already know the date when it is added support for glusterfs? I can work with the test in a test version of glusterfs? there are two parts to the support: 1. managing the gluster hosts/storage/volumes - patches for different parts of this in gerrit - but not needed for first phase of using this. 2. using gluster as a posix fs - vdsm side is ready, and iirc, engine done by laszlo who can share when test patches can be used for testing this Small correction - patches are not at gerrit (referring to Posix FS at engine side) 3. integrating both together - a bit later :) -Original Message- From: Itamar Heim [mailto:ih...@redhat.com] Sent: Friday, March 02, 2012 4:10 AM To: зоррыч Cc: users@ovirt.org Subject: Re: [Users] glusterfs and ovirt On 03/01/2012 08:36 PM, зоррыч wrote: Good news. It already works in a test version or development has not yet begun? early patches to build this support are sent now to engine/vdsm. so work has begun, but not working yet -Original Message- From: Itamar Heim [mailto:ih...@redhat.com] Sent: Thursday, March 01, 2012 7:44 PM To: ?? Cc: users@ovirt.org Subject: Re: [Users] glusterfs and ovirt On 03/01/2012 01:48 PM, ?? wrote: Hi. Test the ability to work as a storage server glusterfs. Direct support to glusterf ovirt unfortunately not. This feature will be added in the future? I'll let someone else reply on the below, but as for ovirt-gluster integration - yes, it is in the works. this gives a general picture of the work being carried out: http://www.ovirt.org/wiki/AddingGlusterSupportToOvirt Attempted to implement a scheme of work - glusterfs mounted on a node in a folder mount glusterfs connected via NFS to ovirt. It works =) Now try to mount NFS to 127.0.0.1 and encountered an error: Command: [root@noc-4-m77 ~] # / bin / mount-o soft, timeo = 600, retrans = 6, nosharecache, vers = 3 -t nfs 127.0.0.1 :/share/tmp /tmpgcOezk Error: mount.nfs: Unknown error 521 NFS V4 is disabled. In this mount: /bin/mount -t nfs 127.0.0.1:/share/ tmp/tmpgtsoetsk is successful. I understand that this is not a problem ovirt, but you might prompt any ideas how to fix it? To use glusterfs in overt to execute a commandL Mount -t glusterfs -o log-level = WARNING, log-file = /var/log/gluster.log noc-1 :/mht / /share I can prescribe it in vdsm that it was carried out instead of /bin/mount-o soft, timeo = 600, retrans = 6, nosharecache, vers = 3 -t nfs 127.0.0.1:/share/tmp/tmpgtsOetsk ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [Users] glusterfs and ovirt
On 05/15/2012 07:35 PM, Andrei Vakhnin wrote: Yair Thanks for an update. Can I have KVM hypervisors also function as storage nodes for glusterfs? What is a release date for glusterfs support? We're looking for a production deployment in June. Thanks Andrei - not sure about release date. I can update you that patches for POSIX-FS (i.e - support for storage domains for POSIX compliant FS), patches for components of oVirt-engine-core and API ) are in gerrit. Most of that work is even merged (I just introduced some changes, hoping to get them reviewed ASAP and get them merged). Andrei On Apr 10, 2012, at 7:18 AM, Yair Zaslavsky wrote: On 04/10/2012 01:43 PM, Itamar Heim wrote: On 04/05/2012 05:25 PM, зоррыч wrote: Already know the date when it is added support for glusterfs? I can work with the test in a test version of glusterfs? there are two parts to the support: 1. managing the gluster hosts/storage/volumes - patches for different parts of this in gerrit - but not needed for first phase of using this. 2. using gluster as a posix fs - vdsm side is ready, and iirc, engine done by laszlo who can share when test patches can be used for testing this Small correction - patches are not at gerrit (referring to Posix FS at engine side) 3. integrating both together - a bit later :) -Original Message- From: Itamar Heim [mailto:ih...@redhat.com] Sent: Friday, March 02, 2012 4:10 AM To: зоррыч Cc: users@ovirt.org Subject: Re: [Users] glusterfs and ovirt On 03/01/2012 08:36 PM, зоррыч wrote: Good news. It already works in a test version or development has not yet begun? early patches to build this support are sent now to engine/vdsm. so work has begun, but not working yet -Original Message- From: Itamar Heim [mailto:ih...@redhat.com] Sent: Thursday, March 01, 2012 7:44 PM To: ?? Cc: users@ovirt.org Subject: Re: [Users] glusterfs and ovirt On 03/01/2012 01:48 PM, ?? wrote: Hi. Test the ability to work as a storage server glusterfs. Direct support to glusterf ovirt unfortunately not. This feature will be added in the future? I'll let someone else reply on the below, but as for ovirt-gluster integration - yes, it is in the works. this gives a general picture of the work being carried out: http://www.ovirt.org/wiki/AddingGlusterSupportToOvirt Attempted to implement a scheme of work - glusterfs mounted on a node in a folder mount glusterfs connected via NFS to ovirt. It works =) Now try to mount NFS to 127.0.0.1 and encountered an error: Command: [root@noc-4-m77 ~] # / bin / mount-o soft, timeo = 600, retrans = 6, nosharecache, vers = 3 -t nfs 127.0.0.1 :/share/tmp /tmpgcOezk Error: mount.nfs: Unknown error 521 NFS V4 is disabled. In this mount: /bin/mount -t nfs 127.0.0.1:/share/ tmp/tmpgtsoetsk is successful. I understand that this is not a problem ovirt, but you might prompt any ideas how to fix it? To use glusterfs in overt to execute a commandL Mount -t glusterfs -o log-level = WARNING, log-file = /var/log/gluster.log noc-1 :/mht / /share I can prescribe it in vdsm that it was carried out instead of /bin/mount-o soft, timeo = 600, retrans = 6, nosharecache, vers = 3 -t nfs 127.0.0.1:/share/tmp/tmpgtsOetsk ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [Users] glusterfs and ovirt
On 04/05/2012 05:25 PM, зоррыч wrote: Already know the date when it is added support for glusterfs? I can work with the test in a test version of glusterfs? there are two parts to the support: 1. managing the gluster hosts/storage/volumes - patches for different parts of this in gerrit - but not needed for first phase of using this. 2. using gluster as a posix fs - vdsm side is ready, and iirc, engine done by laszlo who can share when test patches can be used for testing this 3. integrating both together - a bit later :) -Original Message- From: Itamar Heim [mailto:ih...@redhat.com] Sent: Friday, March 02, 2012 4:10 AM To: зоррыч Cc: users@ovirt.org Subject: Re: [Users] glusterfs and ovirt On 03/01/2012 08:36 PM, зоррыч wrote: Good news. It already works in a test version or development has not yet begun? early patches to build this support are sent now to engine/vdsm. so work has begun, but not working yet -Original Message- From: Itamar Heim [mailto:ih...@redhat.com] Sent: Thursday, March 01, 2012 7:44 PM To: ?? Cc: users@ovirt.org Subject: Re: [Users] glusterfs and ovirt On 03/01/2012 01:48 PM, ?? wrote: Hi. Test the ability to work as a storage server glusterfs. Direct support to glusterf ovirt unfortunately not. This feature will be added in the future? I'll let someone else reply on the below, but as for ovirt-gluster integration - yes, it is in the works. this gives a general picture of the work being carried out: http://www.ovirt.org/wiki/AddingGlusterSupportToOvirt Attempted to implement a scheme of work - glusterfs mounted on a node in a folder mount glusterfs connected via NFS to ovirt. It works =) Now try to mount NFS to 127.0.0.1 and encountered an error: Command: [root@noc-4-m77 ~] # / bin / mount-o soft, timeo = 600, retrans = 6, nosharecache, vers = 3 -t nfs 127.0.0.1 :/share/tmp /tmpgcOezk Error: mount.nfs: Unknown error 521 NFS V4 is disabled. In this mount: /bin/mount -t nfs 127.0.0.1:/share/ tmp/tmpgtsoetsk is successful. I understand that this is not a problem ovirt, but you might prompt any ideas how to fix it? To use glusterfs in overt to execute a commandL Mount -t glusterfs -o log-level = WARNING, log-file = /var/log/gluster.log noc-1 :/mht / /share I can prescribe it in vdsm that it was carried out instead of /bin/mount-o soft, timeo = 600, retrans = 6, nosharecache, vers = 3 -t nfs 127.0.0.1:/share/tmp/tmpgtsOetsk ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [Users] glusterfs and ovirt
On 04/10/2012 01:43 PM, Itamar Heim wrote: On 04/05/2012 05:25 PM, зоррыч wrote: Already know the date when it is added support for glusterfs? I can work with the test in a test version of glusterfs? there are two parts to the support: 1. managing the gluster hosts/storage/volumes - patches for different parts of this in gerrit - but not needed for first phase of using this. 2. using gluster as a posix fs - vdsm side is ready, and iirc, engine done by laszlo who can share when test patches can be used for testing this Small correction - patches are not at gerrit (referring to Posix FS at engine side) 3. integrating both together - a bit later :) -Original Message- From: Itamar Heim [mailto:ih...@redhat.com] Sent: Friday, March 02, 2012 4:10 AM To: зоррыч Cc: users@ovirt.org Subject: Re: [Users] glusterfs and ovirt On 03/01/2012 08:36 PM, зоррыч wrote: Good news. It already works in a test version or development has not yet begun? early patches to build this support are sent now to engine/vdsm. so work has begun, but not working yet -Original Message- From: Itamar Heim [mailto:ih...@redhat.com] Sent: Thursday, March 01, 2012 7:44 PM To: ?? Cc: users@ovirt.org Subject: Re: [Users] glusterfs and ovirt On 03/01/2012 01:48 PM, ?? wrote: Hi. Test the ability to work as a storage server glusterfs. Direct support to glusterf ovirt unfortunately not. This feature will be added in the future? I'll let someone else reply on the below, but as for ovirt-gluster integration - yes, it is in the works. this gives a general picture of the work being carried out: http://www.ovirt.org/wiki/AddingGlusterSupportToOvirt Attempted to implement a scheme of work - glusterfs mounted on a node in a folder mount glusterfs connected via NFS to ovirt. It works =) Now try to mount NFS to 127.0.0.1 and encountered an error: Command: [root@noc-4-m77 ~] # / bin / mount-o soft, timeo = 600, retrans = 6, nosharecache, vers = 3 -t nfs 127.0.0.1 :/share/tmp /tmpgcOezk Error: mount.nfs: Unknown error 521 NFS V4 is disabled. In this mount: /bin/mount -t nfs 127.0.0.1:/share/ tmp/tmpgtsoetsk is successful. I understand that this is not a problem ovirt, but you might prompt any ideas how to fix it? To use glusterfs in overt to execute a commandL Mount -t glusterfs -o log-level = WARNING, log-file = /var/log/gluster.log noc-1 :/mht / /share I can prescribe it in vdsm that it was carried out instead of /bin/mount-o soft, timeo = 600, retrans = 6, nosharecache, vers = 3 -t nfs 127.0.0.1:/share/tmp/tmpgtsOetsk ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [Users] glusterfs and ovirt
I discussed with Zorro of the list and below is an update. Mounting Gluster NFS using loopback is not qualified in Gluster v3.2.5. Upcoming Gluster v3.3.0 will have this feature which will be fully qualified. Regards, Bala - Original Message - From: зоррыч zo...@megatrone.ru To: Balamurugan Arumugam barum...@redhat.com Cc: users@ovirt.org, Itamar Heim ih...@redhat.com Sent: Monday, March 5, 2012 6:42:29 PM Subject: RE: [Users] glusterfs and ovirt [root@noc-4-m77 ~]# gluster --version glusterfs 3.2.5 built on Nov 15 2011 08:43:14 Repository revision: git://git.gluster.com/glusterfs.git Copyright (c) 2006-2011 Gluster Inc. http://www.gluster.com GlusterFS comes with ABSOLUTELY NO WARRANTY. You may redistribute copies of GlusterFS under the terms of the GNU General Public License. [root@noc-4-m77 ~]# -Original Message- From: Balamurugan Arumugam [mailto:barum...@redhat.com] Sent: Monday, March 05, 2012 10:30 AM To: зоррыч Cc: users@ovirt.org; Itamar Heim Subject: Re: [Users] glusterfs and ovirt Hi Zorro, Can you tell me your Gluster version? Regards, Bala - Original Message - From: зоррыч zo...@megatrone.ru To: Itamar Heim ih...@redhat.com Cc: users@ovirt.org Sent: Friday, March 2, 2012 12:06:24 AM Subject: Re: [Users] glusterfs and ovirt Good news. It already works in a test version or development has not yet begun? -Original Message- From: Itamar Heim [mailto:ih...@redhat.com] Sent: Thursday, March 01, 2012 7:44 PM To: ?? Cc: users@ovirt.org Subject: Re: [Users] glusterfs and ovirt On 03/01/2012 01:48 PM, ?? wrote: Hi. Test the ability to work as a storage server glusterfs. Direct support to glusterf ovirt unfortunately not. This feature will be added in the future? I'll let someone else reply on the below, but as for ovirt-gluster integration - yes, it is in the works. this gives a general picture of the work being carried out: http://www.ovirt.org/wiki/AddingGlusterSupportToOvirt Attempted to implement a scheme of work - glusterfs mounted on a node in a folder mount glusterfs connected via NFS to ovirt. It works =) Now try to mount NFS to 127.0.0.1 and encountered an error: Command: [root@noc-4-m77 ~] # / bin / mount-o soft, timeo = 600, retrans = 6, nosharecache, vers = 3 -t nfs 127.0.0.1 :/share/tmp /tmpgcOezk Error: mount.nfs: Unknown error 521 NFS V4 is disabled. In this mount: /bin/mount -t nfs 127.0.0.1:/share/ tmp/tmpgtsoetsk is successful. I understand that this is not a problem ovirt, but you might prompt any ideas how to fix it? To use glusterfs in overt to execute a commandL Mount -t glusterfs -o log-level = WARNING, log-file = /var/log/gluster.log noc-1 :/mht / /share I can prescribe it in vdsm that it was carried out instead of /bin/mount-o soft, timeo = 600, retrans = 6, nosharecache, vers = 3 -t nfs 127.0.0.1:/share/tmp/tmpgtsOetsk ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [Users] glusterfs and ovirt
[root@noc-4-m77 ~]# gluster --version glusterfs 3.2.5 built on Nov 15 2011 08:43:14 Repository revision: git://git.gluster.com/glusterfs.git Copyright (c) 2006-2011 Gluster Inc. http://www.gluster.com GlusterFS comes with ABSOLUTELY NO WARRANTY. You may redistribute copies of GlusterFS under the terms of the GNU General Public License. [root@noc-4-m77 ~]# -Original Message- From: Balamurugan Arumugam [mailto:barum...@redhat.com] Sent: Monday, March 05, 2012 10:30 AM To: зоррыч Cc: users@ovirt.org; Itamar Heim Subject: Re: [Users] glusterfs and ovirt Hi Zorro, Can you tell me your Gluster version? Regards, Bala - Original Message - From: зоррыч zo...@megatrone.ru To: Itamar Heim ih...@redhat.com Cc: users@ovirt.org Sent: Friday, March 2, 2012 12:06:24 AM Subject: Re: [Users] glusterfs and ovirt Good news. It already works in a test version or development has not yet begun? -Original Message- From: Itamar Heim [mailto:ih...@redhat.com] Sent: Thursday, March 01, 2012 7:44 PM To: ?? Cc: users@ovirt.org Subject: Re: [Users] glusterfs and ovirt On 03/01/2012 01:48 PM, ?? wrote: Hi. Test the ability to work as a storage server glusterfs. Direct support to glusterf ovirt unfortunately not. This feature will be added in the future? I'll let someone else reply on the below, but as for ovirt-gluster integration - yes, it is in the works. this gives a general picture of the work being carried out: http://www.ovirt.org/wiki/AddingGlusterSupportToOvirt Attempted to implement a scheme of work - glusterfs mounted on a node in a folder mount glusterfs connected via NFS to ovirt. It works =) Now try to mount NFS to 127.0.0.1 and encountered an error: Command: [root@noc-4-m77 ~] # / bin / mount-o soft, timeo = 600, retrans = 6, nosharecache, vers = 3 -t nfs 127.0.0.1 :/share/tmp /tmpgcOezk Error: mount.nfs: Unknown error 521 NFS V4 is disabled. In this mount: /bin/mount -t nfs 127.0.0.1:/share/ tmp/tmpgtsoetsk is successful. I understand that this is not a problem ovirt, but you might prompt any ideas how to fix it? To use glusterfs in overt to execute a commandL Mount -t glusterfs -o log-level = WARNING, log-file = /var/log/gluster.log noc-1 :/mht / /share I can prescribe it in vdsm that it was carried out instead of /bin/mount-o soft, timeo = 600, retrans = 6, nosharecache, vers = 3 -t nfs 127.0.0.1:/share/tmp/tmpgtsOetsk ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [Users] glusterfs and ovirt
Hi Zorro, Can you tell me your Gluster version? Regards, Bala - Original Message - From: зоррыч zo...@megatrone.ru To: Itamar Heim ih...@redhat.com Cc: users@ovirt.org Sent: Friday, March 2, 2012 12:06:24 AM Subject: Re: [Users] glusterfs and ovirt Good news. It already works in a test version or development has not yet begun? -Original Message- From: Itamar Heim [mailto:ih...@redhat.com] Sent: Thursday, March 01, 2012 7:44 PM To: ?? Cc: users@ovirt.org Subject: Re: [Users] glusterfs and ovirt On 03/01/2012 01:48 PM, ?? wrote: Hi. Test the ability to work as a storage server glusterfs. Direct support to glusterf ovirt unfortunately not. This feature will be added in the future? I'll let someone else reply on the below, but as for ovirt-gluster integration - yes, it is in the works. this gives a general picture of the work being carried out: http://www.ovirt.org/wiki/AddingGlusterSupportToOvirt Attempted to implement a scheme of work - glusterfs mounted on a node in a folder mount glusterfs connected via NFS to ovirt. It works =) Now try to mount NFS to 127.0.0.1 and encountered an error: Command: [root@noc-4-m77 ~] # / bin / mount-o soft, timeo = 600, retrans = 6, nosharecache, vers = 3 -t nfs 127.0.0.1 :/share/tmp /tmpgcOezk Error: mount.nfs: Unknown error 521 NFS V4 is disabled. In this mount: /bin/mount -t nfs 127.0.0.1:/share/ tmp/tmpgtsoetsk is successful. I understand that this is not a problem ovirt, but you might prompt any ideas how to fix it? To use glusterfs in overt to execute a commandL Mount -t glusterfs -o log-level = WARNING, log-file = /var/log/gluster.log noc-1 :/mht / /share I can prescribe it in vdsm that it was carried out instead of /bin/mount-o soft, timeo = 600, retrans = 6, nosharecache, vers = 3 -t nfs 127.0.0.1:/share/tmp/tmpgtsOetsk ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
[Users] glusterfs and ovirt
Hi. Test the ability to work as a storage server glusterfs. Direct support to glusterf ovirt unfortunately not. This feature will be added in the future? Attempted to implement a scheme of work - glusterfs mounted on a node in a folder mount glusterfs connected via NFS to ovirt. It works =) Now try to mount NFS to 127.0.0.1 and encountered an error: Command: [root@noc-4-m77 ~] # / bin / mount-o soft, timeo = 600, retrans = 6, nosharecache, vers = 3 -t nfs 127.0.0.1 :/share/tmp /tmpgcOezk Error: mount.nfs: Unknown error 521 NFS V4 is disabled. In this mount: /bin/mount -t nfs 127.0.0.1:/share/ tmp/tmpgtsoetsk is successful. I understand that this is not a problem ovirt, but you might prompt any ideas how to fix it? To use glusterfs in overt to execute a commandL Mount -t glusterfs -o log-level = WARNING, log-file = /var/log/gluster.log noc-1 :/mht / /share I can prescribe it in vdsm that it was carried out instead of /bin/mount-o soft, timeo = 600, retrans = 6, nosharecache, vers = 3 -t nfs 127.0.0.1:/share/tmp/tmpgtsOetsk ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [Users] glusterfs and ovirt
On 03/01/2012 01:48 PM, ?? wrote: Hi. Test the ability to work as a storage server glusterfs. Direct support to glusterf ovirt unfortunately not. This feature will be added in the future? I'll let someone else reply on the below, but as for ovirt-gluster integration - yes, it is in the works. this gives a general picture of the work being carried out: http://www.ovirt.org/wiki/AddingGlusterSupportToOvirt Attempted to implement a scheme of work - glusterfs mounted on a node in a folder mount glusterfs connected via NFS to ovirt. It works =) Now try to mount NFS to 127.0.0.1 and encountered an error: Command: [root@noc-4-m77 ~] # / bin / mount-o soft, timeo = 600, retrans = 6, nosharecache, vers = 3 -t nfs 127.0.0.1 :/share/tmp /tmpgcOezk Error: mount.nfs: Unknown error 521 NFS V4 is disabled. In this mount: /bin/mount -t nfs 127.0.0.1:/share/ tmp/tmpgtsoetsk is successful. I understand that this is not a problem ovirt, but you might prompt any ideas how to fix it? To use glusterfs in overt to execute a commandL Mount -t glusterfs -o log-level = WARNING, log-file = /var/log/gluster.log noc-1 :/mht / /share I can prescribe it in vdsm that it was carried out instead of /bin/mount-o soft, timeo = 600, retrans = 6, nosharecache, vers = 3 -t nfs 127.0.0.1:/share/tmp/tmpgtsOetsk ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [Users] glusterfs and ovirt
Good news. It already works in a test version or development has not yet begun? -Original Message- From: Itamar Heim [mailto:ih...@redhat.com] Sent: Thursday, March 01, 2012 7:44 PM To: ?? Cc: users@ovirt.org Subject: Re: [Users] glusterfs and ovirt On 03/01/2012 01:48 PM, ?? wrote: Hi. Test the ability to work as a storage server glusterfs. Direct support to glusterf ovirt unfortunately not. This feature will be added in the future? I'll let someone else reply on the below, but as for ovirt-gluster integration - yes, it is in the works. this gives a general picture of the work being carried out: http://www.ovirt.org/wiki/AddingGlusterSupportToOvirt Attempted to implement a scheme of work - glusterfs mounted on a node in a folder mount glusterfs connected via NFS to ovirt. It works =) Now try to mount NFS to 127.0.0.1 and encountered an error: Command: [root@noc-4-m77 ~] # / bin / mount-o soft, timeo = 600, retrans = 6, nosharecache, vers = 3 -t nfs 127.0.0.1 :/share/tmp /tmpgcOezk Error: mount.nfs: Unknown error 521 NFS V4 is disabled. In this mount: /bin/mount -t nfs 127.0.0.1:/share/ tmp/tmpgtsoetsk is successful. I understand that this is not a problem ovirt, but you might prompt any ideas how to fix it? To use glusterfs in overt to execute a commandL Mount -t glusterfs -o log-level = WARNING, log-file = /var/log/gluster.log noc-1 :/mht / /share I can prescribe it in vdsm that it was carried out instead of /bin/mount-o soft, timeo = 600, retrans = 6, nosharecache, vers = 3 -t nfs 127.0.0.1:/share/tmp/tmpgtsOetsk ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [Users] glusterfs and ovirt
On 03/01/2012 08:36 PM, зоррыч wrote: Good news. It already works in a test version or development has not yet begun? early patches to build this support are sent now to engine/vdsm. so work has begun, but not working yet -Original Message- From: Itamar Heim [mailto:ih...@redhat.com] Sent: Thursday, March 01, 2012 7:44 PM To: ?? Cc: users@ovirt.org Subject: Re: [Users] glusterfs and ovirt On 03/01/2012 01:48 PM, ?? wrote: Hi. Test the ability to work as a storage server glusterfs. Direct support to glusterf ovirt unfortunately not. This feature will be added in the future? I'll let someone else reply on the below, but as for ovirt-gluster integration - yes, it is in the works. this gives a general picture of the work being carried out: http://www.ovirt.org/wiki/AddingGlusterSupportToOvirt Attempted to implement a scheme of work - glusterfs mounted on a node in a folder mount glusterfs connected via NFS to ovirt. It works =) Now try to mount NFS to 127.0.0.1 and encountered an error: Command: [root@noc-4-m77 ~] # / bin / mount-o soft, timeo = 600, retrans = 6, nosharecache, vers = 3 -t nfs 127.0.0.1 :/share/tmp /tmpgcOezk Error: mount.nfs: Unknown error 521 NFS V4 is disabled. In this mount: /bin/mount -t nfs 127.0.0.1:/share/ tmp/tmpgtsoetsk is successful. I understand that this is not a problem ovirt, but you might prompt any ideas how to fix it? To use glusterfs in overt to execute a commandL Mount -t glusterfs -o log-level = WARNING, log-file = /var/log/gluster.log noc-1 :/mht / /share I can prescribe it in vdsm that it was carried out instead of /bin/mount-o soft, timeo = 600, retrans = 6, nosharecache, vers = 3 -t nfs 127.0.0.1:/share/tmp/tmpgtsOetsk ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
