On Thu, 15 Dec 2005, David S. Miller wrote:
> From: Bill Fink <[EMAIL PROTECTED]>
> Date: Thu, 15 Dec 2005 20:35:32 -0500
>
> > chance% nuttcp -w2m 192.168.88.8
> > 6299.0625 MB / 10.01 sec = 5278.6065 Mbps 100 %TX 74 %RX
> > chance% nuttcp -r -w2m 192.168.88.8
> > 6221.3125 MB / 10.01 sec = 5213.2026 Mbps 100 %TX 71 %RX
> >
> > And a full test I just did consistently got over 5 Gbps.
>
> Re-enable TSO, and increase the size of the socket buffers
> used by your testcase, retest.
A 2 MB window in the original test should have been sufficient since
a 10-GigE network with a 1 ms RTT should require a TCP window of
BW*RTT or about 1.2 MB.
Anyway, here's the retest you requested (with 5 MB TCP window).
[EMAIL PROTECTED] ethtool -K eth0 tso on
[EMAIL PROTECTED] ethtool -k eth0
Offload parameters for eth0:
rx-checksumming: on
tx-checksumming: on
scatter-gather: on
tcp segmentation offload: on
[EMAIL PROTECTED] ethtool -K eth0 tso on
[EMAIL PROTECTED] ethtool -k eth0
Offload parameters for eth0:
rx-checksumming: on
tx-checksumming: on
scatter-gather: on
tcp segmentation offload: on
chance% nuttcp -w5m 192.168.88.8
3644.1193 MB / 10.03 sec = 3047.8321 Mbps 45 %TX 45 %RX
chance% nuttcp -r -w5m 192.168.88.8
3068.0327 MB / 10.05 sec = 2561.7819 Mbps 35 %TX 36 %RX
And here's a verbose run just to show it is in fact using the
requested 5 MB TCP window (10 MB after Linux bogus doubling).
chance% nuttcp -v -w5m 192.168.88.8
nuttcp-t: v5.1.12: socket
nuttcp-t: buflen=65536, nstream=1, port=5001 tcp -> 192.168.88.8
nuttcp-t: time limit = 10.00 seconds
nuttcp-t: connect to 192.168.88.8
nuttcp-t: send window size = 10485760, receive window size = 524288
nuttcp-t: 3636.7720 MB in 10.01 real seconds = 372027.58 KB/sec = 3047.6499 Mbps
nuttcp-t: 58189 I/O calls, msec/call = 0.18, calls/sec = 5813.00
nuttcp-t: 0.0user 4.5sys 0:10real 45% 0i+0d 0maxrss 0+2pf 602+19csw
nuttcp-r: v5.1.12: socket
nuttcp-r: buflen=65536, nstream=1, port=5001 tcp
nuttcp-r: accept from 192.168.88.10
nuttcp-r: send window size = 524288, receive window size = 10485760
nuttcp-r: 3636.7720 MB in 10.03 real seconds = 371297.50 KB/sec = 3041.6691 Mbps
nuttcp-r: 175041 I/O calls, msec/call = 0.06, calls/sec = 17452.02
nuttcp-r: 0.0user 4.4sys 0:10real 44% 0i+0d 0maxrss 0+2pf 81936+15csw
So performance is still bad with TSO enabled and using a 5 MB TCP window.
-Bill
-
To unsubscribe from this list: send the line "unsubscribe netdev" in
the body of a message to [EMAIL PROTECTED]
More majordomo info at http://vger.kernel.org/majordomo-info.html
