[
https://issues.apache.org/jira/browse/HADOOP-6311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12765195#action_12765195
]
Konstantin Shvachko commented on HADOOP-6311:
---------------------------------------------
I am really hesitant we should commit to Hadoop sources from another project.
As Owen mentioned the main concern is the support of the code. You propose to
commit MBs of new code, which we don't know nothing about and take the burden
of supporting it, if I understood Doug correctly.
- Ok, so does the purpose justifies the sacrifice?
Not sure that even 30% improvement in read performance justifies this. Looking
at your benchmarks I think the number will go down to 10-20% for MapReduce in
general because of data-node overhead, and since not all task reads are local.
- Are there alternatives?
You probably need at least to consider alternatives, and explain why they don't
work. Seems like Dhruba and Raghu made attempts to turn this to solving
problems inside data-node code, which has good chances imo to reach the same
results without massive infusion of alien sources.
> Add support for unix domain sockets to JNI libs
> -----------------------------------------------
>
> Key: HADOOP-6311
> URL: https://issues.apache.org/jira/browse/HADOOP-6311
> Project: Hadoop Common
> Issue Type: New Feature
> Components: native
> Reporter: Todd Lipcon
> Assignee: Todd Lipcon
> Attachments: hadoop-6311.txt
>
>
> For HDFS-347 we need to use unix domain sockets. This JIRA is to include a
> library in common which adds a o.a.h.net.unix package based on the code from
> Android (apache 2 license)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
