[
https://issues.apache.org/jira/browse/PIG-3065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13695911#comment-13695911
]
Johnny Zhang commented on PIG-3065:
-----------------------------------
[~rohini], I see the problem. I want to pick this one. Though I am not clear
for class PigOutputCommitter.java, how can we let it import hadoop 2.x jar, in
where isRecoverySupported() is available in class OutputCommitter.java when
hadoopVersion is 23; and import hadoop 1.x jar, in where isRecoverySupported()
is available in class OutputCommitter.java when hadoopVersion is 20? Any
example of how Pig does this? Thanks.
> pig output format/committer should support recovery for hadoop 0.23
> -------------------------------------------------------------------
>
> Key: PIG-3065
> URL: https://issues.apache.org/jira/browse/PIG-3065
> Project: Pig
> Issue Type: New Feature
> Reporter: Rohini Palaniswamy
> Priority: Minor
>
> In hadoop 0.23 the output committer can optionally support recovery to handle
> the application master getting restarted (failing some # of attempts). If its
> possible the pig outputformat/committer should support recovery.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira