[jira] [Updated] (TEZ-4301) TezChlid OOM cause PipelineSorter may create too many small sort span

[ https://issues.apache.org/jira/browse/TEZ-4301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] CruiseCheung updated TEZ-4301: -- Summary: TezChlid OOM cause PipelineSorter may create too many small sort span (was: TezChlid OOM cause

[jira] [Updated] (TEZ-4301) TezChlid OOM cause PipelineSorter may create too many sort span

[ https://issues.apache.org/jira/browse/TEZ-4301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] CruiseCheung updated TEZ-4301: -- Description: When previous span perItem is  much large than others, reserved.remaining() is large。This 

[jira] [Commented] (TEZ-4301) TezChlid OOM cause PipelineSorter may create too many sort span

[ https://issues.apache.org/jira/browse/TEZ-4301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17315552#comment-17315552 ] CruiseCheung commented on TEZ-4301: --- Added a patch for this issue. Anybody help to review the code? >

[jira] [Updated] (TEZ-4301) TezChlid OOM cause PipelineSorter may create too many sort span

[ https://issues.apache.org/jira/browse/TEZ-4301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] CruiseCheung updated TEZ-4301: -- Attachment: (was: TEZ-4301.1.patch) > TezChlid OOM cause PipelineSorter may create too many sort

[jira] [Updated] (TEZ-4301) TezChlid OOM cause PipelineSorter may create too many sort span

[ https://issues.apache.org/jira/browse/TEZ-4301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] CruiseCheung updated TEZ-4301: -- Attachment: TEZ-4301.1.patch > TezChlid OOM cause PipelineSorter may create too many sort span >

[jira] [Updated] (TEZ-4301) TezChlid OOM cause PipelineSorter may create too many sort span

[ https://issues.apache.org/jira/browse/TEZ-4301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] CruiseCheung updated TEZ-4301: -- Description: When previous span perItem is  much large than others, reserved.remaining() is large。This 

[jira] [Created] (TEZ-4301) TezChlid OOM cause PipelineSorter may create too many sort span

CruiseCheung created TEZ-4301: - Summary: TezChlid OOM cause PipelineSorter may create too many sort span Key: TEZ-4301 URL: https://issues.apache.org/jira/browse/TEZ-4301 Project: Apache Tez

[jira] [Updated] (TEZ-4301) TezChlid OOM cause PipelineSorter may create too many sort span

[ https://issues.apache.org/jira/browse/TEZ-4301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] CruiseCheung updated TEZ-4301: -- Description: When previous span perItem is  much large than others, reserved.remaining() is large。This 

[jira] [Updated] (TEZ-4301) TezChlid OOM cause PipelineSorter may create too many sort span

[ https://issues.apache.org/jira/browse/TEZ-4301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] CruiseCheung updated TEZ-4301: -- Environment: was: Previous sort span: [TezChild] |impl.PipelinedSorter|: Reducer 24:

[jira] [Updated] (TEZ-4260) DagAwareYarnTaskScheduler may assign unfittable container to task

[ https://issues.apache.org/jira/browse/TEZ-4260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] CruiseCheung updated TEZ-4260: -- Description: When tasks in  two vertice require differrent memory size containers and

[jira] [Updated] (TEZ-4260) DagAwareYarnTaskScheduler may assign unfittable container to task

[ https://issues.apache.org/jira/browse/TEZ-4260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] CruiseCheung updated TEZ-4260: -- Description: When tasks in  two vertice require differrent memory size containers and

[jira] [Created] (TEZ-4260) DagAwareYarnTaskScheduler may assign unfittable container to task

CruiseCheung created TEZ-4260: - Summary: DagAwareYarnTaskScheduler may assign unfittable container to task Key: TEZ-4260 URL: https://issues.apache.org/jira/browse/TEZ-4260 Project: Apache Tez

[jira] [Comment Edited] (TEZ-3265) Add preconditions check in SortSpan when available mem is less than metasize

[ https://issues.apache.org/jira/browse/TEZ-3265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17252876#comment-17252876 ] CruiseCheung edited comment on TEZ-3265 at 12/22/20, 3:02 AM: -- Agreed with

[jira] [Commented] (TEZ-3265) Add preconditions check in SortSpan when available mem is less than metasize

[ https://issues.apache.org/jira/browse/TEZ-3265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17252876#comment-17252876 ] CruiseCheung commented on TEZ-3265: --- Agreed with [~zhangweilst], we also met this issue and it`s hard to

[jira] [Updated] (TEZ-3265) Add preconditions check in SortSpan when available mem is less than metasize

[ https://issues.apache.org/jira/browse/TEZ-3265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] CruiseCheung updated TEZ-3265: -- Attachment: TEZ-3265.2.patch > Add preconditions check in SortSpan when available mem is less than