Hello,

My Lustre setup is as follows (see attached setup file):
- Two MDS server in active/passive failover
- Four OSS server in active/active failover
- Mellanox InfiniBand interconnect
- SATA2-FC SAN storage

All servers are Dual AMD Opteron 248 with 4GB RAM running RHEL4 U4 and
Lustre 1.4.7.3 (RPM version). The MDS server are attached to a 16 disk
SATA2-FC4G RAID configured as RAID10 with 4TB capacity. The OSS server
are as pairs attached to two 24 disk SATA2-FC2G RAIDs configured with
redundant paths and controllers and two RAID5 volumes, each providing
5TB capacity. All servers are using Qlogic FC controller QLogic SANBlade
QLE2460 (MDS) and Q-Logic SANBlade QLE2462 (OSS) with qla2xxx-8.01.06
driver. All other hardware drivers are standard RedHat.

I am mounting this Lustre system over InfiniBand on a Quad AMD Opteron
875 with 16GB RAM and run some simple tests in comparision to direct
attached storage of a 16 disk 1TB FC-FC2G RAID system with 8 disks as
RAID5. The server with the attached storage is a Dual AMD Opteron 248
with 8GB RAM.

First test: Download file nr.gz from
ftp://ftp.ncbi.nih.gov/blast/db/FASTA/nr.gz (945MB) and run "time gzip
-d nr.gz"

Lustre: 
real    0m39.343s
user    0m27.603s
sys     0m11.716s
  
Attached storage:
real    0m43.049s
user    0m28.692s
sys     0m8.630s

Second test: Using BLAST 2.2.15 formatdb command for the nr (2155MB)
database "time formatdb -i nr"

Lustre:
real    12m42.931s
user    3m29.847s
sys     9m9.381s

Attached storage:
real    4m6.323s
user    3m21.581s
sys     0m43.857s

Why is the attached storage in this case three times faster then the
Lustre filesystem? When you compare the two "time" outputs you see that
the "sys" part is much higher on Lustre than on the attached storage.
Any suggestions, what I did wrong?

Many thanks,
Jan

Jan Taubert 
Biomathematics and Bioinformatics Division
Rothamsted Research 
West Common, Harpenden, Hertfordshire. AL5 2JQ, UK 
tel: 01582 763133 ext 2108 
fax: 01582 760981 
email: [EMAIL PROTECTED]

Rothamsted Research is a company limited by guarantee, registered in
England under the registration number 2393175 and a not for profit
charity number 802038.
 

Attachment: setup.sh
Description: setup.sh

_______________________________________________
Lustre-discuss mailing list
[email protected]
https://mail.clusterfs.com/mailman/listinfo/lustre-discuss

Reply via email to