[ewg] traffic jittery, send queue full reports from mthca driver

2008-02-06 Thread Or Gerlitz
I just opened case #897 on the below, it happens with last night snapshot.

Or

client MT25204 FW 1.2.0 two CPUs, four cores each
server MT25418 FW 2.3.0 two CPUs, four cores each

client : iperf -c $server -P 4 -d -t 3600 -i 1
server : iperf -s -i 1

[  5] 39.0-40.0 sec  29.4 MBytes246 Mbits/sec
[  4] 39.0-40.0 sec  25.5 MBytes214 Mbits/sec
[  3] 34.0-35.0 sec  88.0 KBytes721 Kbits/sec
[  3] 35.0-36.0 sec  0.00 Bytes  0.00 bits/sec
[  3] 36.0-37.0 sec  0.00 Bytes  0.00 bits/sec
[  3] 37.0-38.0 sec  0.00 Bytes  0.00 bits/sec
[  3] 38.0-39.0 sec  0.00 Bytes  0.00 bits/sec
[  3] 39.0-40.0 sec  0.00 Bytes  0.00 bits/sec
[  5] 40.0-41.0 sec  38.5 MBytes323 Mbits/sec
[  8] 40.0-41.0 sec  36.2 MBytes304 Mbits/sec
[  9] 40.0-41.0 sec  54.3 MBytes456 Mbits/sec
[ 10] 40.0-41.0 sec  32.1 MBytes270 Mbits/sec
[ 11] 40.0-41.0 sec  29.4 MBytes247 Mbits/sec
[SUM] 40.0-41.0 sec152 MBytes  1.28 Gbits/sec

ib_mthca :03:00.0: SQ 000404 full (756910656 head, 756910592 tail, 64 max, 
0 nreq)
ib0: failed to post zlen send
ib_mthca :03:00.0: SQ 000404 full (756915376 head, 756915312 tail, 64 max, 
0 nreq)
ib0: failed to post zlen send
ib_mthca :03:00.0: SQ 000404 full (757146224 head, 757146160 tail, 64 max, 
0 nreq)
ib0: failed to post zlen send
ib_mthca :03:00.0: SQ 000404 full (757146336 head, 757146272 tail, 64 max, 
0 nreq)
ib0: failed to post zlen send
ib_mthca :03:00.0: SQ 000404 full (757317104 head, 757317040 tail, 64 max, 
0 nreq)
ib0: failed to post zlen send
ib_mthca :03:00.0: SQ 000404 full (757361808 head, 757361744 tail, 64 max, 
0 nreq)
ib0: failed to post zlen send
ib_mthca :03:00.0: SQ 000404 full (757361920 head, 757361856 tail, 64 max, 
0 nreq)
ib0: failed to post zlen send
ib_mthca :03:00.0: SQ 000404 full (757515760 head, 757515696 tail, 64 max, 
0 nreq)
ib0: failed to post zlen send
ib_mthca :03:00.0: SQ 000404 full (757515872 head, 757515808 tail, 64 max, 
0 nreq)
ib0: failed to post zlen send
ib_mthca :03:00.0: SQ 000404 full (757515984 head, 757515920 tail, 64 max, 
0 nreq)
ib0: failed to post zlen send
ib_mthca :03:00.0: SQ 000404 full (757516112 head, 757516048 tail, 64 max, 
0 nreq)
ib0: failed to post zlen send
ib_mthca :03:00.0: SQ 000404 full (757516224 head, 757516160 tail, 64 max, 
0 nreq)
ib0: failed to post zlen send
ib_mthca :03:00.0: SQ 000404 full (757516352 head, 757516288 tail, 64 max, 
0 nreq)
ib0: failed to post zlen send
ib_mthca :03:00.0: SQ 000404 full (757516448 head, 757516384 tail, 64 max, 
0 nreq)
ib0: failed to post zlen send
ib_mthca :03:00.0: SQ 000404 full (757516576 head, 757516512 tail, 64 max, 
0 nreq)
ib0: failed to post zlen send
ib_mthca :03:00.0: SQ 000404 full (757523168 head, 757523104 tail, 64 max, 
0 nreq)
ib0: failed to post zlen send
ib_mthca :03:00.0: SQ 000404 full (757531472 head, 757531408 tail, 64 max, 
0 nreq)
ib0: failed to post zlen send
ib_mthca :03:00.0: SQ 000404 full (757531568 head, 757531504 tail, 64 max, 
0 nreq)
ib0: failed to post zlen send
ib_mthca :03:00.0: SQ 000404 full (757548064 head, 757548000 tail, 64 max, 
0 nreq)
ib0: failed to post zlen send
ib_mthca :03:00.0: SQ 000404 full (757582992 head, 757582928 tail, 64 max, 
0 nreq)
ib0: failed to post zlen send
ib_mthca :03:00.0: SQ 000404 full (758082528 head, 758082464 tail, 64 max, 
0 nreq)
ib0: failed to post zlen send
ib_mthca :03:00.0: SQ 000404 full (758162208 head, 758162144 tail, 64 max, 
0 nreq)
ib0: failed to post zlen send
ib_mthca :03:00.0: SQ 000404 full (758232720 head, 758232656 tail, 64 max, 
0 nreq)
ib0: failed to post zlen send
ib_mthca :03:00.0: SQ 000404 full (758232848 head, 758232784 tail, 64 max, 
0 nreq)
ib0: failed to post zlen send
ib_mthca :03:00.0: SQ 000404 full (758232960 head, 758232896 tail, 64 max, 
0 nreq)
ib0: failed to post zlen send
ib_mthca :03:00.0: SQ 000404 full (758233088 head, 758233024 tail, 64 max, 
0 nreq)
ib0: failed to post zlen send
ib_mthca :03:00.0: SQ 000404 full (758303696 head, 758303632 tail, 64 max, 
0 nreq)
ib0: failed to post zlen send
ib_mthca :03:00.0: SQ 000404 full (758303776 head, 758303712 tail, 64 max, 
0 nreq)
ib0: failed to post zlen send
ib_mthca :03:00.0: SQ 000404 full (758307744 head, 758307680 tail, 64 max, 
0 nreq)
ib0: failed to post zlen send
ib_mthca :03:00.0: SQ 000404 full (758307872 head, 758307808 tail, 64 max, 
0 nreq)
ib0: failed to post zlen send
ib_mthca :03:00.0: SQ 000404 full (758334928 head, 758334864 tail, 64 max, 
0 nreq)
ib0: failed to post zlen send
ib_mthca :03:00.0: SQ 000404 full (758335056 head, 758334992 tail, 64 max, 
0 nreq)
ib0: failed to post zlen send
ib_mthca :03:00.0: SQ 000404 full (758341744 head, 758341680 tail, 64 max, 
0 nreq)
ib0: failed to post zlen send
ib_mthca :03:00.0: SQ 000404 full (758341856 head, 758341792 tail, 64 max, 
0 nreq)
ib0: failed to post zlen send
ib_mthca :03:00.0: SQ 000404 full (758396784 

Re: [ewg] traffic jittery, send queue full reports from mthca driver

2008-02-06 Thread Shirley Ma
Hello Or,

I found out that if you increase send_queue_size and recv_queue_size,
like 1K, this problem will be gone.

Thanks
Shirley

___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg