MetadataStorageSpace /meta
and /meta is a single partition 3TB 6Gb SATA drive formatted with ext3.Here are some new performance numbers: [root@fatcompute-11-32 gaus]# ls poyx*|wc -l 127 [root@fatcompute-11-32 gaus]# time rm -f poyx* real 1m51.938s user 0m0.000s sys 0m0.014s[root@fatcompute-11-32 gaus]# date;for i in `seq 1 50`;do touch file${i};done;date
Tue May 28 16:47:01 MDT 2013 Tue May 28 16:47:26 MDT 2013 Thanks, Mike On 5/28/13 4:03 PM, Becky Ligon wrote:
Michael:
To increase the amount of cache available to Berkeley DB, set the
following option in your conf file and restart all of your servers:
<Filesystem>
<StorageHints>
DBCacheSizeBytes 1610612736
</StorageHints>
</Filesystem>
I have attached an example conf file that sets the Berkeley DB cache
size to 1GB.
Becky
On Fri, May 24, 2013 at 6:06 PM, Michael Robbert <[email protected]
<mailto:[email protected]>> wrote:
We recently noticed a performance problem with our OrangeFS server.
Here are the server stats:
3 servers, built identically with identical hardware
[root@orangefs02 ~]# /usr/sbin/pvfs2-server --version
2.8.7-orangefs (mode: aio-threaded)
[root@orangefs02 ~]# uname -r
2.6.18-308.16.1.el5.584g0000
4 core E5603 1.60GHz
12GB of RAM
OrangeFS is being served to clients using bmi_tcp over DDR Infiniband.
Backend storage is PanFS with 2x10Gig connections on the servers.
Performance to the backend looks fine using bonnie++. >100MB/sec
write and ~250MB/s read to each stack. ~300 creates/sec.
On the OrangeFS clients are running kernel version 2.6.18-238.19.1.el5.
The biggest problem I have right now is that delete are taking a
long time. Almost 1 sec per file.
[root@fatcompute-11-32 L_10_V0.2_eta0.3_wRes___truncerr1e-11]# find
N2/|wc -l
137
[root@fatcompute-11-32 L_10_V0.2_eta0.3_wRes___truncerr1e-11]# time
rm -rf N2
real 1m31.096s
user 0m0.000s
sys 0m0.015s
Similar results for file creates:
[root@fatcompute-11-32 ]# date;for i in `seq 1 50`;do touch
file${i};done;date
Fri May 24 16:04:17 MDT 2013
Fri May 24 16:05:05 MDT 2013
What else do you need to know? Which debug flags? What should we be
looking at?
I don't see any load on the servers and I've restarted server and
rebooted server nodes.
Thanks for any pointers,
Mike Robbert
Colorado School of Mines
_______________________________________________
Pvfs2-users mailing list
[email protected]
<mailto:[email protected]>
http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
--
Becky Ligon
OrangeFS Support and Development
Omnibond Systems
Anderson, South Carolina
smime.p7s
Description: S/MIME Cryptographic Signature
_______________________________________________ Pvfs2-users mailing list [email protected] http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
