Ming Ma created TEZ-3206:
----------------------------
Summary: Have unordered partitioned KV output send partition stats
via VertexManagerEvent
Key: TEZ-3206
URL: https://issues.apache.org/jira/browse/TEZ-3206
Project: Apache Tez
Issue Type: New Feature
Reporter: Ming Ma
As part of the auto-parallelism feature, ordered partitioned KV output's
partition stats are sent to ShuffleVertexManager via VertexManagerEvent. But
this isn't available for unordered partitioned output. Having
{{UnorderedPartitionedKVWriter}} send partition stats will enable the
auto-parallelism support for unordered KV or other custom data routing
mechanisms that depend on partition size.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)