[
https://issues.apache.org/jira/browse/HADOOP-19926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18094415#comment-18094415
]
Aaron Fabbri commented on HADOOP-19926:
---------------------------------------
This is probably better suited to a thread on
[[email protected].|mailto:[email protected].]
Interesting project. Is there a demand for this feature?
I have a lot of experience with RDMA development so I took a quick look. The
Ohio State projects look a bit experimental. For something production /
upstream quality I'd want to centralize the networking API in one place (i.e.
Hadoop Common) instead of hacking on forks of different projects. Also I don't
see any need to get MPI involved: Just starting with zero-copy kernel bypass
support in place of regular network sockets would be a likely first step. I
assume they have a JNI shim that talks to libibverbs / librdma on linux.
> Use RDMA in Hadoop project
> --------------------------
>
> Key: HADOOP-19926
> URL: https://issues.apache.org/jira/browse/HADOOP-19926
> Project: Hadoop Common
> Issue Type: New Feature
> Reporter: Ivan Andika
> Assignee: Ivan Andika
> Priority: Major
>
> Raised this to start a discussion with the Hadoop community.
> While researching RDMA, I encountered the HIBD project
> ([https://hibd.cse.ohio-state.edu/]) that uses RDMA on Hadoop. Technically,
> we can decompile the Hadoop JAR using [https://github.com/java-decompiler]
> and extract the RDMA usage. However, the concern is whether this is compliant
> to ASF policy.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
