[
https://issues.apache.org/jira/browse/HADOOP-12547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14988032#comment-14988032
]
Allen Wittenauer commented on HADOOP-12547:
-------------------------------------------
As someone who has been around a lot longer than Colin, let me fill in some
blanks.
Pipes was written primarily for Yahoo!'s search team. It was provided as a way
for C code to interface with MapReduce without requiring significant rewrites.
It was definitely in use before I left Yahoo! but I haven't kept track of
whether it is still being used. My guess is no, given most of that team has
left/was shipped over to Microsoft.
Even so, there are definitely references out on the Internet in the last year
to people using Pipes if one actually bothers to look for them. e.g.,
http://stackoverflow.com/questions/28573127/hadoop-pipes-wordcount-example-nullpointerexception-in-localjobrunner
, which features a comment made about Hadoop 2.6 about 5 days ago.
> Remove hadoop-pipes
> -------------------
>
> Key: HADOOP-12547
> URL: https://issues.apache.org/jira/browse/HADOOP-12547
> Project: Hadoop Common
> Issue Type: Improvement
> Reporter: Colin Patrick McCabe
> Assignee: Colin Patrick McCabe
> Priority: Minor
>
> Development appears to have stopped on hadoop-pipes upstream for the last few
> years, aside from very basic maintenance. Hadoop streaming seems to be a
> better alternative, since it supports more programming languages and is
> better implemented.
> There were no responses to a message on the mailing list asking for users of
> Hadoop pipes... and in my experience, I have never seen anyone use this. We
> should remove it to reduce our maintenance burden and build times.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
