On May 13, 2008, at 12:37 PM, Emmanuel Florac wrote:
Hi, I've made a pvfs2 cluster to agregate storage from 2 machines. The machines run Linux Debian etch with 2.6.22.19 linux. All is well, both machines are identical with 3Ware raid controllers, and write disk thruput is about 550MB/s. Each machine has 4 GigEth ports. I've dedicated 2 of them to link themachines together (bonding, 802.3ad) for the pvfs traffic, the 2 othersare connected to the outside world. The purpose is to provide a rough ftp/samba storage thru the VFS layer, and it works fine. However the performance is abysmal : the network thruput between the nodes is 8MB/s while copying! the total cluster write performance(cp from local disk to pvfs storage) is 17 MB/s.... What can be going sowrong? Any hint would be appreciated.
Hi Emmanuel,I would first make sure that you don't have some network bottleneck unrelated to PVFS. What does netperf between the two nodes give you? If that's not the issue, you might try setting up a single server on a single node (just with a separate config file), and mount that pvfs volume on the same node. That will allow you to see the performance of PVFS straight to disk without the network involved.
-sam
-- -------------------------------------------------- Emmanuel Florac www.intellique.com -------------------------------------------------- _______________________________________________ Pvfs2-users mailing list [email protected] http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
smime.p7s
Description: S/MIME cryptographic signature
_______________________________________________ Pvfs2-users mailing list [email protected] http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
