Joe Landman
Thu, 25 Sep 2008 09:02:43 -0700
Scott Atchley wrote:
On Sep 25, 2008, at 10:19 AM, Joe Landman wrote:We have measured NFSoverRDMA speeds (on SDR IB at that) at 460 MB/s, on an RDMA adapter reporting 750 MB/s (in a 4x PCIe slot, so ~860 MB/s max is what we should expect for this). Faster IB hardware should result in better performance, though you still have to walk through the various software stacks, and they ... remove efficiency ... (nice PC way to say that they slow things down a bit :( )Joe,Even though recent kernels allow rsize and wsize of 1 MB for TCP, RPCRDMA only supports 32 KB. This will limit your throughput some regardless of faster hardware.
I saw some messages to that effect a while ago (from you as I remember) on another list.
10 or more Gb network, and the RDMA version lets you do a spoonful of data at a time ... Do'h!
-- Joseph Landman, Ph.D Founder and CEO Scalable Informatics LLC, email: [EMAIL PROTECTED] web : http://www.scalableinformatics.com http://jackrabbit.scalableinformatics.com phone: +1 734 786 8423 x121 fax : +1 866 888 3112 cell : +1 734 612 4615 _______________________________________________ Beowulf mailing list, Beowulf@beowulf.org To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf