[
https://issues.apache.org/jira/browse/SYSTEMML-513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15144009#comment-15144009
]
Matthias Boehm commented on SYSTEMML-513:
-----------------------------------------
ad 1: solved by explicit separation of hadoop 1/2 and MRv1/MRv2 configurations
ad 2: I was not able to reproduce this issue on a hadoop 2.2 cluster w/ MRv1
support. However, we can rewrite the problematic code of
MultipleOutputCommitter in a more robust way which makes it independent from
the existence of JobContext.TASK_ISMAP in the job conf.
> MapReduce v1 backwards compatibility support
> --------------------------------------------
>
> Key: SYSTEMML-513
> URL: https://issues.apache.org/jira/browse/SYSTEMML-513
> Project: SystemML
> Issue Type: Bug
> Reporter: Matthias Boehm
> Assignee: Matthias Boehm
>
> We did not run SystemML on MRv1 for a while which led to various
> incompatibilities (e.g.,
> https://www.mail-archive.com/dev@systemml.incubator.apache.org/msg00312.html).
> Furthermore, there are issues with regard to hadoop2 and MRv1 deployments.
> This task covers all related aspects of making SystemML work on MRv1 again.
> 1) Generalization MRv1 configuration selection
> 2) Version-specific handling of multiple output logic
> 3) Version-specific usage of newer hdfs apis
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
