On Sat, 25 Apr 2009, Jiaqing Du wrote:
> Hi, List > > I'm playing with two Intel 10 Gigabit CX4 Dual Port Server Adapters located > at two different machines and connected by network cables directly. These > two cards sit on two x8 PCIe slots. > > The tuning I did includes setting interrupt affinity and process affinity, > using jumbo frames, and changing related kernel network parameters. > Basically, I referred to the following two documents. > > 1) 10 Gb Ethernet, > www.redhat.com/promo/summit/2008/downloads/pdf/Thursday/Mark_Wagner.pdf > 2) Linux kernel documentation, > http://www.mjmwired.net/kernel/Documentation/networking/ixgb.txt > > For one pair of ports located at two different machines, the maximum TCP > throughput I could get is about 8900Mb/s. This number just comes from > setting interrupt affinity and using jumbo frames. Changing other parts of > the system configuration could not give me a better number. as measured by the application? what application? how many threads were you running and was it TCP or UDP? What did you set your interrupt rate to? How many receive queues? What kernel? I am missing lots of data :-) Also, what kind of system, and how fast is your memory? netperf test to localhost is a decent indication of memory bandwidth. netserver netperf -T0,0 -C -c netperf -T0,1 -C -c netperf -T0,2 -C -c > Can I get a higher throughput with more tuning or this is what I can get > from CX4 adapters? you should always be able to achieve 9.4Gb/s (with 1500 MTU) using netperf and the result should be higher with jumbo frames enabled. The CX4 interconnect makes no difference to the throughput. a typical netperf run I use is remote: netserver local: netperf -H <remote> -l 30 -t TCP_MAERTS -C -c -- -m 64K ------------------------------------------------------------------------------ Crystal Reports - New Free Runtime and 30 Day Trial Check out the new simplified licensign option that enables unlimited royalty-free distribution of the report engine for externally facing server and web deployment. http://p.sf.net/sfu/businessobjects _______________________________________________ E1000-devel mailing list E1000-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/e1000-devel
