Hadoop works with Java 7, which has builtin SDP support. You'll need to pass SDP related properties (-Dcom.sun.sdp.conf=your_sdp.conf) to hadoop JVMs via env var HADOOP_OPTS.
One caveat of SDP is the 64KB message size (performance cliff beyond 64KB), which _should_ work with default hadoop config, where dfs packet size is 64KB. __Luke On Tue, Oct 8, 2013 at 4:49 PM, Yasin Celik <yasinceli...@gmail.com> wrote: > Hello, > > I looked around but I think it seems there is no Sockets Direct > Protocol(SDP) support in Hadoop RPC. > I basically want to take advantage of Infiniband when transferring data. > Is there any known support for this? Has anybody tried this before? > > Best > > --------- > Yasin Celik >
