[
https://issues.apache.org/jira/browse/TEZ-1128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siddharth Seth updated TEZ-1128:
--------------------------------
Attachment: TEZ-1128.1.txt
Simple patch to setup the partitions so that they are visible in the
MRPartitioner.
> OnFileUnorderedPartitionedKVOutput does not handle partitioning correctly
> with the MRPartitioner
> ------------------------------------------------------------------------------------------------
>
> Key: TEZ-1128
> URL: https://issues.apache.org/jira/browse/TEZ-1128
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Rohini Palaniswamy
> Assignee: Siddharth Seth
> Attachments: TEZ-1128.1.txt
>
>
> Two issues:
> 1) It does not set value of
> TezJobConfig.TEZ_RUNTIME_NUM_EXPECTED_PARTITIONS. So MRPartitioner assumes
> the number of partitions is 1 and goes with a default partitioner that writes
> only to last partition.
> 2) If one of the partitions has empty output (due to issue 1) it gets stuck
> without fetching input.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
