[
https://issues.apache.org/jira/browse/SPARK-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16292595#comment-16292595
]
Steve Loughran commented on SPARK-18294:
----------------------------------------
Following up on this, one question: Why support the older mapred protocol?
The standard impl in Hadoop just relays to the new stuff, it just complicates
everyones life as there's two test paths, APIs to document, risk of different
failure modes.
The v1 API isn't being actively developed, and really its time to move off it
> Implement commit protocol to support `mapred` package's committer
> -----------------------------------------------------------------
>
> Key: SPARK-18294
> URL: https://issues.apache.org/jira/browse/SPARK-18294
> Project: Spark
> Issue Type: Sub-task
> Components: Spark Core
> Reporter: Jiang Xingbo
> Assignee: Jiang Xingbo
> Fix For: 2.3.0
>
>
> Current `FileCommitProtocol` is based on `mapreduce` package, we should
> implement a `HadoopMapRedCommitProtocol` that supports the older mapred
> package's commiter.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
