Ben, What is the 8-stream BW you are seeing with IPoIB when using datagram mode and MTU=1500?
Boris Shpolyansky Sr. Member of Technical Staff, Applications Mellanox Technologies Inc. 350 Oakmead Parkway, Suite 100 Sunnyvale, CA 94085 Tel.: (408) 916 0014 Fax: (408) 585 0314 Cell: (408) 834 9365 www.mellanox.com -----Original Message----- From: Ben [mailto:[email protected]] Sent: Monday, March 09, 2009 5:19 PM To: Boris Shpolyansky Cc: [email protected] Subject: Re: [ofa-general] ipoib performanec at smaller mtu I have a similar setup in datagram, and don't see a big difference. Are these numbers expected? I guess I would like to understand the limitations. It seams like these numbers are a bit below what the hardware is capable of even with lro off. -Ben On Mar 9, 2009, at 6:09 PM, Boris Shpolyansky wrote: > I think for small MTU sizes you will see better performance with IPoIB > in datagram mode. > > Boris Shpolyansky > Sr. Member of Technical Staff, Applications > > Mellanox Technologies Inc. > 350 Oakmead Parkway, Suite 100 > Sunnyvale, CA 94085 > Tel.: (408) 916 0014 > Fax: (408) 585 0314 > Cell: (408) 834 9365 > www.mellanox.com > > -----Original Message----- > From: [email protected] > [mailto:[email protected]] On Behalf Of > Benjamin M. > McClelland > Sent: Monday, March 09, 2009 4:19 PM > To: [email protected] > Subject: [ofa-general] ipoib performanec at smaller mtu > > I was curious what other people are seeing for 1500 mtu performance on > ipoib. Current tests are showing that I get about 150-175MB/s no > matter > how many streams. If I go up to higher mtu, then performance > significantly increases. Due to the storage network that this ib is > routing to, we are currently limited to 1500 mtu. > > ofed 1.4.1, connected mode, dual opteron dual core 1.8GHz, Mellanox > Technologies MT25418 [ConnectX IB DDR, PCIe 2.0 2.5GT/s] (rev a0) fw > 2.6.000, voltaire sm on switch > > lro disabled, send_queue_size=256 > > thanks, > -Ben > _______________________________________________ > general mailing list > [email protected] > http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general > > To unsubscribe, please visit > http://openib.org/mailman/listinfo/openib-general _______________________________________________ general mailing list [email protected] http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
