We recently noticed a performance problem with our OrangeFS server.
Here are the server stats: 3 servers, built identically with identical hardware [root@orangefs02 ~]# /usr/sbin/pvfs2-server --version 2.8.7-orangefs (mode: aio-threaded) [root@orangefs02 ~]# uname -r 2.6.18-308.16.1.el5.584g0000 4 core E5603 1.60GHz 12GB of RAM OrangeFS is being served to clients using bmi_tcp over DDR Infiniband.Backend storage is PanFS with 2x10Gig connections on the servers. Performance to the backend looks fine using bonnie++. >100MB/sec write and ~250MB/s read to each stack. ~300 creates/sec.
On the OrangeFS clients are running kernel version 2.6.18-238.19.1.el5.The biggest problem I have right now is that delete are taking a long time. Almost 1 sec per file.
[root@fatcompute-11-32 L_10_V0.2_eta0.3_wRes_truncerr1e-11]# find N2/|wc -l 137 [root@fatcompute-11-32 L_10_V0.2_eta0.3_wRes_truncerr1e-11]# time rm -rf N2 real 1m31.096s user 0m0.000s sys 0m0.015s Similar results for file creates:[root@fatcompute-11-32 ]# date;for i in `seq 1 50`;do touch file${i};done;date
Fri May 24 16:04:17 MDT 2013 Fri May 24 16:05:05 MDT 2013What else do you need to know? Which debug flags? What should we be looking at? I don't see any load on the servers and I've restarted server and rebooted server nodes.
Thanks for any pointers, Mike Robbert Colorado School of Mines
smime.p7s
Description: S/MIME Cryptographic Signature
_______________________________________________ Pvfs2-users mailing list [email protected] http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
