Rohini Palaniswamy created TEZ-1128:
---------------------------------------
Summary: OnFileUnorderedPartitionedKVOutput does not handle
partitioning correctly
Key: TEZ-1128
URL: https://issues.apache.org/jira/browse/TEZ-1128
Project: Apache Tez
Issue Type: Bug
Reporter: Rohini Palaniswamy
Two issues:
1) It does not set value of
TezJobConfig.TEZ_RUNTIME_NUM_EXPECTED_PARTITIONS. So MRPartitioner assumes the
number of partitions is 1 and goes with a default partitioner that writes only
to last partition.
2) If one of the partitions has empty output (due to issue 1) it gets stuck
without fetching input.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
