The kernel developers introduced a bug into ext4 that has yet to be fixed. If you use xfs you won't have those hangs.

On 03/01/2013 01:30 AM, Nikita A Kardashin wrote:
Hello again!

I am complete rebuild my storage.
As base: ext4 over mdadm-raid1
Gluster volume in distributed-replicated mode with settings:

Options Reconfigured:
performance.cache-size: 1024MB
nfs.disable: on
performance.write-behind-window-size: 4MB
performance.io-thread-count: 64
features.quota: off
features.quota-timeout: 1800
performance.io-cache: on
performance.write-behind: on
performance.flush-behind: on
performance.read-ahead: on

As result, I got write performance about 80MB/s on dd if=/dev/zero of=testfile.bin bs=100M count=10, but I also got some strange things. If I try to execute above command inside virtual machine (KVM), first time all going right - about 900MB/s (cache effect, I think), but if I run this test again on existing file - task (dd) hungs up and can be stopped only by Ctrl+C.

Overall virtual system latency is poor too. For example, apt-get upgrade upgrading system very, very slow, freezing on "Unpacking replacement" and other io-related steps.

Does glusterfs have any tuning options, that can help me?


2013/2/27 Brian Candler <[email protected] <mailto:[email protected]>>

    On Wed, Feb 27, 2013 at 02:46:28PM +0000, Robert van Leeuwen wrote:
    > You could try to trunk the network on your client but 10Gbit
    ethernet ( i suggest to use fiber, because of latency issues with
    copper 10Gbit)

    Aside: 10G with SFP+ direct-attach cables also works well, even
    though it's
    copper.  The latency problem is with 10Gbase-T (RJ45 / CAT6(a))
    _______________________________________________
    Gluster-users mailing list
    [email protected] <mailto:[email protected]>
    http://supercolony.gluster.org/mailman/listinfo/gluster-users




--
With best regards,
differentlocal (www.differentlocal.ru <http://www.differentlocal.ru> | [email protected] <mailto:[email protected]>),
System administrator.


_______________________________________________
Gluster-users mailing list
[email protected]
http://supercolony.gluster.org/mailman/listinfo/gluster-users

_______________________________________________
Gluster-users mailing list
[email protected]
http://supercolony.gluster.org/mailman/listinfo/gluster-users

Reply via email to