On Fri, Feb 18, 2011 at 10:32 AM, Rajat Sharma <sh.raj...@gmail.com> wrote: > Hi Guys > > I am trying to work on HDFS to improve its performance by adding RDMA > functionality to its code. But i cannot find any sort of documentation or > help regarding this topic except some information about Socket Direct > Protocol or Allocated buffers. since RDMA is the premier protocol which is > highly preferred for Distributed File Systems , why is it not preferred in > case of HDFS or what are the factors which makes it tough. Any suggestions > or papers or ideas regarding the ways we can get some way to work on it. I > am using OFED Distribution , RDMA for this.
HDFS really serves a different purpose from other distributed filesystems. I'd argue that RDMA is a premature optimization that would introduce a lot of complexity in to the code base. If you are using it right, much of your data traffic with HDFS doesn't go over the network at all. -- Chris
