As expected increasing the cache didn't have much if any effect on delete performance. However I also got a chance to move my meta data to local disk and that didn't have much effect either. create time is a little better, nothing great. Each server has the following setting:
        MetadataStorageSpace /meta
and /meta is a single partition 3TB 6Gb SATA drive formatted with ext3.

Here are some new performance numbers:

[root@fatcompute-11-32 gaus]# ls poyx*|wc -l
127
[root@fatcompute-11-32 gaus]# time rm -f poyx*

real    1m51.938s
user    0m0.000s
sys     0m0.014s
[root@fatcompute-11-32 gaus]# date;for i in `seq 1 50`;do touch file${i};done;date
Tue May 28 16:47:01 MDT 2013
Tue May 28 16:47:26 MDT 2013

Thanks,
Mike



On 5/28/13 4:03 PM, Becky Ligon wrote:
Michael:

To increase the amount of cache available to Berkeley DB, set the
following option in your conf file and restart all of your servers:

<Filesystem>
   <StorageHints>
         DBCacheSizeBytes 1610612736
   </StorageHints>
</Filesystem>

I have attached an example conf file that sets the Berkeley DB cache
size to 1GB.

Becky



On Fri, May 24, 2013 at 6:06 PM, Michael Robbert <[email protected]
<mailto:[email protected]>> wrote:

    We recently noticed a performance problem with our OrangeFS server.

    Here are the server stats:
    3 servers, built identically with identical hardware

    [root@orangefs02 ~]# /usr/sbin/pvfs2-server --version
    2.8.7-orangefs (mode: aio-threaded)

    [root@orangefs02 ~]# uname -r
    2.6.18-308.16.1.el5.584g0000

    4 core E5603 1.60GHz
    12GB of RAM

    OrangeFS is being served to clients using bmi_tcp over DDR Infiniband.
    Backend storage is PanFS with 2x10Gig connections on the servers.
    Performance to the backend looks fine using bonnie++. >100MB/sec
    write and ~250MB/s read to each stack. ~300 creates/sec.

    On the OrangeFS clients are running kernel version 2.6.18-238.19.1.el5.

    The biggest problem I have right now is that delete are taking a
    long time. Almost 1 sec per file.

    [root@fatcompute-11-32 L_10_V0.2_eta0.3_wRes___truncerr1e-11]# find
    N2/|wc -l
    137
    [root@fatcompute-11-32 L_10_V0.2_eta0.3_wRes___truncerr1e-11]# time
    rm -rf N2

    real    1m31.096s
    user    0m0.000s
    sys     0m0.015s

    Similar results for file creates:

    [root@fatcompute-11-32 ]# date;for i in `seq 1 50`;do touch
    file${i};done;date
    Fri May 24 16:04:17 MDT 2013
    Fri May 24 16:05:05 MDT 2013

    What else do you need to know? Which debug flags? What should we be
    looking at?
    I don't see any load on the servers and I've restarted server and
    rebooted server nodes.

    Thanks for any pointers,
    Mike Robbert
    Colorado School of Mines


    _______________________________________________
    Pvfs2-users mailing list
    [email protected]
    <mailto:[email protected]>
    http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users




--
Becky Ligon
OrangeFS Support and Development
Omnibond Systems
Anderson, South Carolina


Attachment: smime.p7s
Description: S/MIME Cryptographic Signature

_______________________________________________
Pvfs2-users mailing list
[email protected]
http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users

Reply via email to