[
https://issues.apache.org/jira/browse/TEZ-3772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Muhammad Samir Khan updated TEZ-3772:
-------------------------------------
Attachment: tez-3772.001.patch
Added new configurations to distinguish between small/regular vertex and to set
different min/max fractions for slowstart for small vertices.
> Allow slowstart for small jobs to be treated differently
> --------------------------------------------------------
>
> Key: TEZ-3772
> URL: https://issues.apache.org/jira/browse/TEZ-3772
> Project: Apache Tez
> Issue Type: Improvement
> Reporter: Muhammad Samir Khan
> Assignee: Muhammad Samir Khan
> Attachments: tez-3772.001.patch
>
>
> If there are a small number of reduces (configurable), then having a
> different threshold can benefit. Performance of jobs with a small number of
> reduce tasks can benefit significantly. Yes, the job could specify slowstart
> as 0.0 instead of the default, but that requires job owners to do something.
> It would be better if the defaults did something more optimal for both large
> and small jobs.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
