On May 14, 2007 16:17 -0600, Daniel Leaberry wrote: > I ordered the beefiest MDS I could (quad proc dual core opterons with > 16GB ram) and put it on the fastest array I could (14 drive raid 10 with > 15k rpm disks). Still, as always, I'm wondering if I can do better.
You should get a noticable boost when moving to 1.6. It has much better internal locking for the DLM to scale on many-core systems. > Our workload often involves downloading ~50000 small > (4-10k) xml files as fast as possible. How many OSTs do you have, and what is the OSC precreate count on the MDS? If the MDS isn't precreating at least 50000 objects in advance of your "burst" it may be waiting for objects from the OSTs. > My understanding is that the > biggest performance increase I would see is moving to infiniband instead > of tcp interconnects. Yes, that would likely be a noticable win. The TCP transaction rate is limited to about 5k/sec, while IB can do 20k/sec or more. You might get a boost by having multiple TCP connections into the MDS also. Cheers, Andreas -- Andreas Dilger Principal Software Engineer Cluster File Systems, Inc. _______________________________________________ Lustre-discuss mailing list [email protected] https://mail.clusterfs.com/mailman/listinfo/lustre-discuss
