Re: [ovirt-users] oVirt selft-hosted with NFS on top gluster

2017-09-08 Thread Abi Askushi
Hi all, Seems that I am seeing light in he tunnel! I have done the below: Added the option /etc/glusterfs/glusterd.vol : option rpc-auth-allow-insecure on restarted glusterd Then set the volume option: gluster volume set vms server.allow-insecure on Then disabled the option: gluster volume

Re: [ovirt-users] oVirt selft-hosted with NFS on top gluster

2017-09-08 Thread Abi Askushi
I don't see any other bottleneck. CPUs are quite idle. Seems that the load is mostly due to high latency on IO. Reading further the gluster docs: https://github.com/gluster/glusterfs-specs/blob/master/done/GlusterFS%203.5/libgfapi%20with%20qemu%20libvirt.md I see that I am missing the following

Re: [ovirt-users] oVirt selft-hosted with NFS on top gluster

2017-09-07 Thread Yaniv Kaul
On Thu, Sep 7, 2017 at 12:52 PM, Abi Askushi wrote: > > > On Thu, Sep 7, 2017 at 10:30 AM, Yaniv Kaul wrote: > >> >> >> On Thu, Sep 7, 2017 at 10:06 AM, Yaniv Kaul wrote: >> >>> >>> >>> On Wed, Sep 6, 2017 at 6:08 PM, Abi Askushi

Re: [ovirt-users] oVirt selft-hosted with NFS on top gluster

2017-09-07 Thread Abi Askushi
On Thu, Sep 7, 2017 at 10:30 AM, Yaniv Kaul wrote: > > > On Thu, Sep 7, 2017 at 10:06 AM, Yaniv Kaul wrote: > >> >> >> On Wed, Sep 6, 2017 at 6:08 PM, Abi Askushi >> wrote: >> >>> For a first idea I use: >>> >>> dd if=/dev/zero

Re: [ovirt-users] oVirt selft-hosted with NFS on top gluster

2017-09-07 Thread Yaniv Kaul
On Thu, Sep 7, 2017 at 10:06 AM, Yaniv Kaul wrote: > > > On Wed, Sep 6, 2017 at 6:08 PM, Abi Askushi > wrote: > >> For a first idea I use: >> >> dd if=/dev/zero of=testfile bs=1GB count=1 >> > > This is an incorrect way to test performance, for various

Re: [ovirt-users] oVirt selft-hosted with NFS on top gluster

2017-09-07 Thread Yaniv Kaul
On Wed, Sep 6, 2017 at 6:08 PM, Abi Askushi wrote: > For a first idea I use: > > dd if=/dev/zero of=testfile bs=1GB count=1 > This is an incorrect way to test performance, for various reasons: 1. You are not using oflag=direct , thus not using DirectIO, but using cache.

Re: [ovirt-users] oVirt selft-hosted with NFS on top gluster

2017-09-06 Thread Abi Askushi
For a first idea I use: dd if=/dev/zero of=testfile bs=1GB count=1 When testing on the gluster mount point using above command I hardly get 10MB/s. (On the same time the network traffic hardly reaches 100Mbit). When testing our of the gluster (for example at /root) I get 600 - 700MB/s. When I

Re: [ovirt-users] oVirt selft-hosted with NFS on top gluster

2017-09-06 Thread Yaniv Kaul
On Wed, Sep 6, 2017 at 3:32 PM, Abi Askushi wrote: > Hi All, > > I've playing with ovirt self hosted engine setup and I even use it to > production for several VM. The setup I have is 3 server with gluster > storage in replica 2+1 (1 arbiter). > The data storage domain

[ovirt-users] oVirt selft-hosted with NFS on top gluster

2017-09-06 Thread Abi Askushi
Hi All, I've playing with ovirt self hosted engine setup and I even use it to production for several VM. The setup I have is 3 server with gluster storage in replica 2+1 (1 arbiter). The data storage domain where VMs are stored is mounted with gluster through ovirt. The performance I get for the