[jira] [Commented] (TEZ-3128) Avoid stopping containers on the AM shutdown thread

[ https://issues.apache.org/jira/browse/TEZ-3128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15168481#comment-15168481 ] Siddharth Seth commented on TEZ-3128: - [~ozawa] - looking at the scheduler, we already release all held

[jira] [Commented] (TEZ-1911) MergeManager's unconditionalReserve() should check for memory limits before allocating memory to IntermediateMemoryToMemoryMerger

[ https://issues.apache.org/jira/browse/TEZ-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15168469#comment-15168469 ] TezQA commented on TEZ-1911: {color:red}-1 overall{color}. Here are the results of testing the latest

Failed: TEZ-1911 PreCommit Build #1516

Jira: https://issues.apache.org/jira/browse/TEZ-1911 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/1516/ ### ## LAST 60 LINES OF THE CONSOLE ###

[jira] [Commented] (TEZ-1911) MergeManager's unconditionalReserve() should check for memory limits before allocating memory to IntermediateMemoryToMemoryMerger

[ https://issues.apache.org/jira/browse/TEZ-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15168468#comment-15168468 ] Siddharth Seth commented on TEZ-1911: - +1. Thanks! > MergeManager's unconditionalReserve() should check

[jira] [Commented] (TEZ-3141) mapreduce.task.timeout is not translated to container heartbeat timeout

[ https://issues.apache.org/jira/browse/TEZ-3141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15168438#comment-15168438 ] Siddharth Seth commented on TEZ-3141: - I completely forgot about the separate maps in DeprecatedKeys.

[jira] [Commented] (TEZ-1911) MergeManager's unconditionalReserve() should check for memory limits before allocating memory to IntermediateMemoryToMemoryMerger

[ https://issues.apache.org/jira/browse/TEZ-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15168327#comment-15168327 ] Rajesh Balamohan commented on TEZ-1911: --- Agreed. Added a check for early-exit before actual merging.

[jira] [Updated] (TEZ-1911) MergeManager's unconditionalReserve() should check for memory limits before allocating memory to IntermediateMemoryToMemoryMerger

[ https://issues.apache.org/jira/browse/TEZ-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-1911: -- Attachment: TEZ-1911.3.patch > MergeManager's unconditionalReserve() should check for memory

Failed: TEZ-1911 PreCommit Build #1515

Jira: https://issues.apache.org/jira/browse/TEZ-1911 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/1515/ ### ## LAST 60 LINES OF THE CONSOLE ###

[jira] [Commented] (TEZ-1911) MergeManager's unconditionalReserve() should check for memory limits before allocating memory to IntermediateMemoryToMemoryMerger

[ https://issues.apache.org/jira/browse/TEZ-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15168223#comment-15168223 ] TezQA commented on TEZ-1911: {color:red}-1 overall{color}. Here are the results of testing the latest

[jira] [Commented] (TEZ-1911) MergeManager's unconditionalReserve() should check for memory limits before allocating memory to IntermediateMemoryToMemoryMerger

[ https://issues.apache.org/jira/browse/TEZ-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15168127#comment-15168127 ] Siddharth Seth commented on TEZ-1911: - bq. One more question - does the interrupt status have to be

[jira] [Commented] (TEZ-3114) Shuffle OOM due to EventMetaData flood

[ https://issues.apache.org/jira/browse/TEZ-3114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15168124#comment-15168124 ] Siddharth Seth commented on TEZ-3114: - +1 > Shuffle OOM due to EventMetaData flood >

[jira] [Created] (TEZ-3142) Intermediate mem-to-mem enhancements

Rajesh Balamohan created TEZ-3142: - Summary: Intermediate mem-to-mem enhancements Key: TEZ-3142 URL: https://issues.apache.org/jira/browse/TEZ-3142 Project: Apache Tez Issue Type:

[jira] [Updated] (TEZ-1911) MergeManager's unconditionalReserve() should check for memory limits before allocating memory to IntermediateMemoryToMemoryMerger

[ https://issues.apache.org/jira/browse/TEZ-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-1911: -- Attachment: TEZ-1911.2.patch Thanks [~sseth]. Addressed review comments in .2 patch -Removed

[jira] [Commented] (TEZ-3139) VertexInfo is missing in tez-ui / ATS

[ https://issues.apache.org/jira/browse/TEZ-3139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15168032#comment-15168032 ] Rajesh Balamohan commented on TEZ-3139: --- This is with ATS1.5 (but ended up using ATSHistoryLogging

[jira] [Commented] (TEZ-3128) Avoid stopping containers on the AM shutdown thread

[ https://issues.apache.org/jira/browse/TEZ-3128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15167944#comment-15167944 ] Tsuyoshi Ozawa commented on TEZ-3128: - [~sseth] [~hitesh] could you check the patch? > Avoid stopping

[jira] [Updated] (TEZ-3077) TezClient.waitTillReady should support timeout

[ https://issues.apache.org/jira/browse/TEZ-3077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated TEZ-3077: - Attachment: TEZ-3077.001.patch Putting an initial patch based on peer comments. Do we want to change the

Failed: TEZ-3141 PreCommit Build #1514

Jira: https://issues.apache.org/jira/browse/TEZ-3141 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/1514/ ### ## LAST 60 LINES OF THE CONSOLE ###

[jira] [Commented] (TEZ-3141) mapreduce.task.timeout is not translated to container heartbeat timeout

[ https://issues.apache.org/jira/browse/TEZ-3141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15167679#comment-15167679 ] TezQA commented on TEZ-3141: {color:red}-1 overall{color}. Here are the results of testing the latest

[jira] [Commented] (TEZ-3139) VertexInfo is missing in tez-ui / ATS

[ https://issues.apache.org/jira/browse/TEZ-3139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15167667#comment-15167667 ] Hitesh Shah commented on TEZ-3139: -- [~rajesh.balamohan] Is this reproducible with ATSv1.5? It will be

[jira] [Commented] (TEZ-3140) Reduce AM memory usage while serialization

[ https://issues.apache.org/jira/browse/TEZ-3140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15167665#comment-15167665 ] Rohini Palaniswamy commented on TEZ-3140: - bq. -1 tests included. The patch doesn't appear to

[jira] [Commented] (TEZ-3140) Reduce AM memory usage while serialization

[ https://issues.apache.org/jira/browse/TEZ-3140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15167648#comment-15167648 ] TezQA commented on TEZ-3140: {color:red}-1 overall{color}. Here are the results of testing the latest

[jira] [Commented] (TEZ-3114) Shuffle OOM due to EventMetaData flood

[ https://issues.apache.org/jira/browse/TEZ-3114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15167645#comment-15167645 ] TezQA commented on TEZ-3114: {color:red}-1 overall{color}. Here are the results of testing the latest

Failed: TEZ-3140 PreCommit Build #1513

Jira: https://issues.apache.org/jira/browse/TEZ-3140 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/1513/ ### ## LAST 60 LINES OF THE CONSOLE ###

Failed: TEZ-3114 PreCommit Build #1512

Jira: https://issues.apache.org/jira/browse/TEZ-3114 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/1512/ ### ## LAST 60 LINES OF THE CONSOLE ###

[jira] [Updated] (TEZ-3141) mapreduce.task.timeout is not translated to container heartbeat timeout

[ https://issues.apache.org/jira/browse/TEZ-3141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated TEZ-3141: Attachment: TEZ-3141.001.patch Patch that adds the deprecation to the DAG key map as well. >

[jira] [Commented] (TEZ-3140) Reduce AM memory usage while serialization

[ https://issues.apache.org/jira/browse/TEZ-3140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15167447#comment-15167447 ] Rohini Palaniswamy commented on TEZ-3140: - It would have been easy if we can do bb.array(), but

[jira] [Created] (TEZ-3141) mapreduce.task.timeout is not translated to container heartbeat timeout

Jason Lowe created TEZ-3141: --- Summary: mapreduce.task.timeout is not translated to container heartbeat timeout Key: TEZ-3141 URL: https://issues.apache.org/jira/browse/TEZ-3141 Project: Apache Tez

[jira] [Updated] (TEZ-3140) Reduce AM memory usage while serialization

[ https://issues.apache.org/jira/browse/TEZ-3140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated TEZ-3140: Attachment: TEZ-3140-1.patch > Reduce AM memory usage while serialization >

[jira] [Updated] (TEZ-3140) Reduce AM memory usage while serialization

[ https://issues.apache.org/jira/browse/TEZ-3140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated TEZ-3140: Attachment: (was: TEZ-3140-1.patch) > Reduce AM memory usage while serialization >

[jira] [Comment Edited] (TEZ-3140) Reduce AM memory usage while serialization

[ https://issues.apache.org/jira/browse/TEZ-3140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15167433#comment-15167433 ] Rohini Palaniswamy edited comment on TEZ-3140 at 2/25/16 4:56 PM: -- Avoided

[jira] [Updated] (TEZ-3140) Reduce AM memory usage while serialization

[ https://issues.apache.org/jira/browse/TEZ-3140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated TEZ-3140: Attachment: TEZ-3140-1.patch > Reduce AM memory usage while serialization >

[jira] [Updated] (TEZ-3140) Reduce AM memory usage while serialization

[ https://issues.apache.org/jira/browse/TEZ-3140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated TEZ-3140: Fix Version/s: 0.8.3 > Reduce AM memory usage while serialization >

[jira] [Created] (TEZ-3140) Reduce AM memory usage while serialization

Rohini Palaniswamy created TEZ-3140: --- Summary: Reduce AM memory usage while serialization Key: TEZ-3140 URL: https://issues.apache.org/jira/browse/TEZ-3140 Project: Apache Tez Issue Type:

[jira] [Updated] (TEZ-3139) VertexInfo is missing in tez-ui / ATS

[ https://issues.apache.org/jira/browse/TEZ-3139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-3139: -- Attachment: am.log.tar.gz am log > VertexInfo is missing in tez-ui / ATS >

[jira] [Updated] (TEZ-3139) VertexInfo is missing in tez-ui / ATS

[ https://issues.apache.org/jira/browse/TEZ-3139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-3139: -- Attachment: dag_1456147314798_0254_1.zip attaching the ats data downloaded via tez-ui page >

[jira] [Comment Edited] (TEZ-3139) VertexInfo is missing in tez-ui / ATS

[ https://issues.apache.org/jira/browse/TEZ-3139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15167141#comment-15167141 ] Rajesh Balamohan edited comment on TEZ-3139 at 2/25/16 12:24 PM: - This is

[jira] [Updated] (TEZ-3139) VertexInfo is missing in tez-ui / ATS

[ https://issues.apache.org/jira/browse/TEZ-3139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-3139: -- Attachment: tez_ui.png This is with master branch. > VertexInfo is missing in tez-ui / ATS >

[jira] [Created] (TEZ-3139) VertexInfo is missing in tez-ui / ATS

Rajesh Balamohan created TEZ-3139: - Summary: VertexInfo is missing in tez-ui / ATS Key: TEZ-3139 URL: https://issues.apache.org/jira/browse/TEZ-3139 Project: Apache Tez Issue Type: Bug

[jira] [Commented] (TEZ-1911) MergeManager's unconditionalReserve() should check for memory limits before allocating memory to IntermediateMemoryToMemoryMerger

[ https://issues.apache.org/jira/browse/TEZ-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15166911#comment-15166911 ] Siddharth Seth commented on TEZ-1911: - One more question - does the interrupt status have to be checked

[jira] [Commented] (TEZ-1911) MergeManager's unconditionalReserve() should check for memory limits before allocating memory to IntermediateMemoryToMemoryMerger

[ https://issues.apache.org/jira/browse/TEZ-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15166910#comment-15166910 ] Siddharth Seth commented on TEZ-1911: - {code} LOG.info(inputContext.getSourceVertexName() + ": " +