On Jun 11, 2009, at 11:22 AM, David Bonnie wrote:
Hey everyone -
Nick and I have completed our modifications to store metadata and
data separately and are in the process of testing/benchmarking. Our
initial results are incredibly good (on the order of nearly twice as
fast as 2.8.1) but we're wondering if maybe we should tune the
standard release a bit to make it a more fair comparison.
What is twice as fast? Metadata ops? Bulk I/O? Everything?
Our setup is as follows:
3 I/O nodes, each serving metadata and data
Dual core Opterons in each node
10 Gbit Myrinet interconnects (PVFS2 runs on this)
Cool. :-)
Are you setting FlowBufferSizeBytes in your config file? If so, what
value are you using?
Scott
1 Gbit management network
Infiniband is in the works, we'll test on this as well
Data is on a 1 TB Seagate 7200.11 (metadata as well for the 2.8.1
release)
Metadata is stored on an Intel X-25E for our new code
We haven't tuned anything in particular on either version of PVFS2.
It has been suggested we increase the amount of data written before
syncing metadata to about 4 MB to decrease the load on the metadata
server. Is this a good idea and does anyone have any tips or links
to point me toward to make this a better comparison?
Thanks!
- Dave
_______________________________________________
Pvfs2-developers mailing list
[email protected]
http://www.beowulf-underground.org/mailman/listinfo/pvfs2-developers
_______________________________________________
Pvfs2-developers mailing list
[email protected]
http://www.beowulf-underground.org/mailman/listinfo/pvfs2-developers
