I believe so. Last week I was rsyncing some file to the file system. Yesterday I needed to delete a bunch of them and that is when I noticed the problem. On closer inspection it looks like rsync still writes quickly with large files(100MB/s), but bonnie++ is quite a bit slower(20MB/s). So for now I'm just concerned with the MD performance.
It is stored on the same PanFS systems as the data.

Mike

On 5/24/13 5:47 PM, Boyd Wilson wrote:
Michael,
You said slowdown, was it performing better before and slowed down?

Also where are your MD file stored?

-b


On Fri, May 24, 2013 at 6:06 PM, Michael Robbert <[email protected]
<mailto:[email protected]>> wrote:

    We recently noticed a performance problem with our OrangeFS server.

    Here are the server stats:
    3 servers, built identically with identical hardware

    [root@orangefs02 ~]# /usr/sbin/pvfs2-server --version
    2.8.7-orangefs (mode: aio-threaded)

    [root@orangefs02 ~]# uname -r
    2.6.18-308.16.1.el5.584g0000

    4 core E5603 1.60GHz
    12GB of RAM

    OrangeFS is being served to clients using bmi_tcp over DDR Infiniband.
    Backend storage is PanFS with 2x10Gig connections on the servers.
    Performance to the backend looks fine using bonnie++. >100MB/sec
    write and ~250MB/s read to each stack. ~300 creates/sec.

    On the OrangeFS clients are running kernel version 2.6.18-238.19.1.el5.

    The biggest problem I have right now is that delete are taking a
    long time. Almost 1 sec per file.

    [root@fatcompute-11-32 L_10_V0.2_eta0.3_wRes___truncerr1e-11]# find
    N2/|wc -l
    137
    [root@fatcompute-11-32 L_10_V0.2_eta0.3_wRes___truncerr1e-11]# time
    rm -rf N2

    real    1m31.096s
    user    0m0.000s
    sys     0m0.015s

    Similar results for file creates:

    [root@fatcompute-11-32 ]# date;for i in `seq 1 50`;do touch
    file${i};done;date
    Fri May 24 16:04:17 MDT 2013
    Fri May 24 16:05:05 MDT 2013

    What else do you need to know? Which debug flags? What should we be
    looking at?
    I don't see any load on the servers and I've restarted server and
    rebooted server nodes.

    Thanks for any pointers,
    Mike Robbert
    Colorado School of Mines


    _______________________________________________
    Pvfs2-users mailing list
    [email protected]
    <mailto:[email protected]>
    http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users



Attachment: smime.p7s
Description: S/MIME Cryptographic Signature

_______________________________________________
Pvfs2-users mailing list
[email protected]
http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users

Reply via email to