Rohini Palaniswamy created PIG-4735:
---------------------------------------
Summary: PartitionerDefinedVertexManager should do slowstart
Key: PIG-4735
URL: https://issues.apache.org/jira/browse/PIG-4735
Project: Pig
Issue Type: Improvement
Components: tez
Reporter: Rohini Palaniswamy
Assignee: Daniel Dai
Fix For: 0.16.0
Currently all the partitioner vertex and final reducer vertex tasks are started
as soon as the sampler vertex completes. The final reducer vertex tasks should
only start after a percentage of partitioner vertex tasks have completed. We
need to do same kind of slow start as ShuffleVertexManager honoring
ShuffleVertexManager.TEZ_SHUFFLE_VERTEX_MANAGER_MIN_SRC_FRACTION and
ShuffleVertexManager.TEZ_SHUFFLE_VERTEX_MANAGER_MAX_SRC_FRACTION configurations
and their defaults.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
