[
https://issues.apache.org/jira/browse/TEZ-2978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siddharth Seth updated TEZ-2978:
--------------------------------
Attachment: TEZ-2978.1.txt
Patch to add an option to allow small splits before rack locality. It's intent
is to allow all big groups to form first - and once none can be formed, smaller
splits are allowed.
[~bikassaha] - please review.
> Add an option to allow small splits early on in TezSplitGrouper
> ---------------------------------------------------------------
>
> Key: TEZ-2978
> URL: https://issues.apache.org/jira/browse/TEZ-2978
> Project: Apache Tez
> Issue Type: Improvement
> Reporter: Siddharth Seth
> Attachments: TEZ-2978.1.txt
>
>
> In certain cases, allowing the last few splits to be 'small' - smaller than
> the requested size is beneficial, and can end up creating fewer splits. Also
> this results in all splits having some form of locality information.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
