Hello, My Lustre setup is as follows (see attached setup file): - Two MDS server in active/passive failover - Four OSS server in active/active failover - Mellanox InfiniBand interconnect - SATA2-FC SAN storage
All servers are Dual AMD Opteron 248 with 4GB RAM running RHEL4 U4 and Lustre 1.4.7.3 (RPM version). The MDS server are attached to a 16 disk SATA2-FC4G RAID configured as RAID10 with 4TB capacity. The OSS server are as pairs attached to two 24 disk SATA2-FC2G RAIDs configured with redundant paths and controllers and two RAID5 volumes, each providing 5TB capacity. All servers are using Qlogic FC controller QLogic SANBlade QLE2460 (MDS) and Q-Logic SANBlade QLE2462 (OSS) with qla2xxx-8.01.06 driver. All other hardware drivers are standard RedHat. I am mounting this Lustre system over InfiniBand on a Quad AMD Opteron 875 with 16GB RAM and run some simple tests in comparision to direct attached storage of a 16 disk 1TB FC-FC2G RAID system with 8 disks as RAID5. The server with the attached storage is a Dual AMD Opteron 248 with 8GB RAM. First test: Download file nr.gz from ftp://ftp.ncbi.nih.gov/blast/db/FASTA/nr.gz (945MB) and run "time gzip -d nr.gz" Lustre: real 0m39.343s user 0m27.603s sys 0m11.716s Attached storage: real 0m43.049s user 0m28.692s sys 0m8.630s Second test: Using BLAST 2.2.15 formatdb command for the nr (2155MB) database "time formatdb -i nr" Lustre: real 12m42.931s user 3m29.847s sys 9m9.381s Attached storage: real 4m6.323s user 3m21.581s sys 0m43.857s Why is the attached storage in this case three times faster then the Lustre filesystem? When you compare the two "time" outputs you see that the "sys" part is much higher on Lustre than on the attached storage. Any suggestions, what I did wrong? Many thanks, Jan Jan Taubert Biomathematics and Bioinformatics Division Rothamsted Research West Common, Harpenden, Hertfordshire. AL5 2JQ, UK tel: 01582 763133 ext 2108 fax: 01582 760981 email: [EMAIL PROTECTED] Rothamsted Research is a company limited by guarantee, registered in England under the registration number 2393175 and a not for profit charity number 802038.
setup.sh
Description: setup.sh
_______________________________________________ Lustre-discuss mailing list [email protected] https://mail.clusterfs.com/mailman/listinfo/lustre-discuss
