Hi Brian, I'm just wondering if you had any luck with figuring out performance
limitations of your setup. I'm testing a similar configuration, so any tips or
recommendations would be much appreciated. Thanks, --Alex
___
Gluster-users mailing list
On Fri, Jun 08, 2012 at 09:30:19PM +0100, Brian Candler wrote:
ubuntu@lucidtest:~$ dd if=/dev/zero of=/var/tmp/test.zeros2 bs=1024k count=100
100+0 records in
100+0 records out
104857600 bytes (105 MB) copied, 14.5182 s, 7.2 MB/s
And this is after live-migrating the VM to dev-storage2:
On Sat, Jun 09, 2012 at 09:53:05AM +0100, Brian Candler wrote:
So clearly cache='none' (O_DIRECT) makes a big difference when using a
local filesystem, so I'd very much like to be able to test it with gluster.
Aha, O_DIRECT is in 3.4+:
Final point. I tried remounting the volume using an undocumented setting I
saw in another posting:
mount -o direct-io-mode=enable -t glusterfs dev-storage1:/single1
/gluster/single1
But with that, and KVM also using cache=none, the VM simply hung on startup.
This looks like a bug to me.
With
On Fri, Jun 08, 2012 at 12:19:58AM -0400, olav johansen wrote:
# mount -t glusterfs fs1:/data-storage /storage
I've copied over my data to it again and doing a ls several times,
takes ~0.5 seconds:
[@web1 files]# time ls -all|wc -l
Like I said before, please also try without the
On Thu, Jun 07, 2012 at 02:36:26PM +0100, Brian Candler wrote:
I'm interested in understanding this, especially the split-brain scenarios
(better to understand them *before* you're stuck in a problem :-)
BTW I'm in the process of building a 2-node 3.3 test cluster right now.
FYI, I have got
On Fri, Jun 08, 2012 at 05:46:42PM +0100, Brian Candler wrote:
but glusterfs objected to the cache='none' option (possibly this opens the
file with O_DIRECT?)
Yes that's definitely the problem, as I can see if I strace the kvm process:
stat(/gluster/safe/images/lucidtest/tmpaJqTD9.qcow2,
; gluster-users@gluster.org; Fernando Frediani (Qube)
Subject: Re: [Gluster-users] Performance optimization tips Gluster 3.3? (small
files / directory listings)
On Thu, Jun 07, 2012 at 02:36:26PM +0100, Brian Candler wrote:
I'm interested in understanding this, especially the split-brain
scenarios
Hi Brian,
This is a single thread trying to process a sequential task where the
latency really becomes a problem with ls -aR I get similar speed:
[@web1 files]# time ls -aR|wc -l
1968316
real27m23.432s
user0m5.523s
sys 0m35.369s
[@web1 files]# time ls -aR|wc -l
1968316
real
On Fri, Jun 08, 2012 at 02:23:57PM -0400, olav johansen wrote:
This is a single thread trying to process a sequential task where the
latency really becomes a problem with ls -aR I get similar speed:
That's interesting.
[@web1 files]# time ls -aR|wc -l
1968316
real
On Fri, Jun 08, 2012 at 05:46:42PM +0100, Brian Candler wrote:
The VM boots with io='native' and bus='virtio', but performance is still
very poor:
ubuntu@lucidtest:~$ dd if=/dev/zero of=/var/tmp/test.zeros bs=1024k
count=100
100+0 records in
100+0 records out
104857600
] Performance optimization tips Gluster 3.3? (small
files / directory listings)
Hi,
I'm using Gluster 3.3.0-1.el6.x86_64, on two storage nodes, replicated mode
(fs1, fs2)
Node specs: CentOS 6.2 Intel Quad Core 2.8Ghz, 4Gb ram, 3ware raid, 2x500GB
sata 7200rpm (RAID1 for os), 6x1TB sata 7200rpm
On Thu, Jun 07, 2012 at 10:10:03AM +, Fernando Frediani (Qube) wrote:
Sorry this reply won’t be of any help to your problem, but I am too
curious to understand how it can be even slower if monting using
Gluster client which I would expect always be quicker than NFS or
anything
the link right now.
- Original Message -
From: olav johansen luxis2...@gmail.com
To: gluster-users@gluster.org
Sent: Thursday, June 7, 2012 8:02:14 AM
Subject: [Gluster-users] Performance optimization tips Gluster 3.3? (small
files / directory listings)
Hi,
I'm using Gluster 3.3.0-1.el6
, June 7, 2012 7:00:14 AM
Subject: Re: [Gluster-users] Performance optimization tips Gluster3.3?
(small files / directory listings)
Hello there.
That's really interesting, because we think about using GlusterFS too
with a
similar setup/scenario.
I read about a really strange
...@qubenet.net
Cc: olav johansen luxis2...@gmail.com, gluster-users@gluster.org
gluster-users@gluster.org
Sent: Thursday, June 7, 2012 4:24:37 PM
Subject: Re: [Gluster-users] Performance optimization tips Gluster 3.3? (small
files / directory listings)
On Thu, Jun 07, 2012 at 10:10:03AM +
On Thu, Jun 07, 2012 at 08:34:56AM -0400, Pranith Kumar Karampuri wrote:
Brian,
Small correction: 'sending queries to *both* servers to check they are in
sync - even read accesses.' Read fops like stat/getxattr etc are sent to only
one brick.
Is that new behaviour for 3.3? My
johansen luxis2...@gmail.com, gluster-users@gluster.org, Fernando
Frediani (Qube) fernando.fredi...@qubenet.net
Sent: Thursday, June 7, 2012 7:06:26 PM
Subject: Re: [Gluster-users] Performance optimization tips Gluster 3.3? (small
files / directory listings)
On Thu, Jun 07, 2012 at 08:34:56AM -0400
...@pobox.com
To: Pranith Kumar Karampuri pkara...@redhat.com
Cc: olav johansen luxis2...@gmail.com, gluster-users@gluster.org,
Fernando Frediani (Qube) fernando.fredi...@qubenet.net
Sent: Thursday, June 7, 2012 7:06:26 PM
Subject: Re: [Gluster-users] Performance optimization tips Gluster 3.3?
(small
Hi,
I'm using Gluster 3.3.0-1.el6.x86_64, on two storage nodes, replicated mode
(fs1, fs2)
Node specs: CentOS 6.2 Intel Quad Core 2.8Ghz, 4Gb ram, 3ware raid, 2x500GB
sata 7200rpm (RAID1 for os), 6x1TB sata 7200rpm (RAID10 for /data), 1Gbit
network
I've it mounted data partition to web1 a Dual
, June 7, 2012 8:02:14 AM
Subject: [Gluster-users] Performance optimization tips Gluster 3.3? (small
files / directory listings)
Hi,
I'm using Gluster 3.3.0-1.el6.x86_64, on two storage nodes, replicated mode
(fs1, fs2)
Node specs: CentOS 6.2 Intel Quad Core 2.8Ghz, 4Gb ram, 3ware raid
21 matches
Mail list logo
