[jira] [Updated] (TEZ-3105) Tez does not run on IBM JDK 7 or 8

[ https://issues.apache.org/jira/browse/TEZ-3105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Senia updated TEZ-3105: Attachment: TezMxBeanResourceCalculator.WORKS.java This works Very similar to how Flink folk implemented

[jira] [Updated] (TEZ-3105) Tez does not run on IBM JDK 7 or 8

[ https://issues.apache.org/jira/browse/TEZ-3105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Senia updated TEZ-3105: Attachment: TezMxBeanResourceCalculator.DOESNOTWORK.java This is the full class it does not work.. Not sure

[jira] [Updated] (TEZ-3105) Tez does not run on IBM JDK 7 or 8

[ https://issues.apache.org/jira/browse/TEZ-3105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Senia updated TEZ-3105: Attachment: DOESNOTWORK.txt I added some printStacks in my copy but it does not work Not sure how we

[jira] [Comment Edited] (TEZ-3105) Tez does not run on IBM JDK 7 or 8

[ https://issues.apache.org/jira/browse/TEZ-3105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15170402#comment-15170402 ] Greg Senia edited comment on TEZ-3105 at 2/27/16 7:02 AM: -- [~gopalv] or [~hitesh] I

[jira] [Commented] (TEZ-3105) Tez does not run on IBM JDK 7 or 8

[ https://issues.apache.org/jira/browse/TEZ-3105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15170402#comment-15170402 ] Greg Senia commented on TEZ-3105: - [~gopalv] or [~hitesh] I attempted the above and Tez no longer works

[jira] [Commented] (TEZ-3147) Intermediate mem-to-mem: Fix early exit when only one segment can fit into memory

[ https://issues.apache.org/jira/browse/TEZ-3147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15170347#comment-15170347 ] Siddharth Seth commented on TEZ-3147: - +1 > Intermediate mem-to-mem: Fix early exit when only one

[jira] [Commented] (TEZ-3147) Intermediate mem-to-mem: Fix early exit when only one segment can fit into memory

[ https://issues.apache.org/jira/browse/TEZ-3147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15170338#comment-15170338 ] TezQA commented on TEZ-3147: {color:green}+1 overall{color}. Here are the results of testing the latest

Success: TEZ-3147 PreCommit Build #1523

Jira: https://issues.apache.org/jira/browse/TEZ-3147 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/1523/ ### ## LAST 60 LINES OF THE CONSOLE ###

[jira] [Updated] (TEZ-3147) Intermediate mem-to-mem: Fix early exit when only one segment can fit into memory

[ https://issues.apache.org/jira/browse/TEZ-3147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-3147: -- Attachment: TEZ-3147.1.patch [~sseth] - Please review when you find time. This should go along

[jira] [Created] (TEZ-3147) Intermediate mem-to-mem: Fix early exit when only one segment can fit into memory

Rajesh Balamohan created TEZ-3147: - Summary: Intermediate mem-to-mem: Fix early exit when only one segment can fit into memory Key: TEZ-3147 URL: https://issues.apache.org/jira/browse/TEZ-3147

[jira] [Commented] (TEZ-1911) MergeManager's unconditionalReserve() should check for memory limits before allocating memory to IntermediateMemoryToMemoryMerger

[ https://issues.apache.org/jira/browse/TEZ-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15170247#comment-15170247 ] Rajesh Balamohan commented on TEZ-1911: --- committed addendum patch to master. >>> commit

[jira] [Updated] (TEZ-1911) MergeManager's unconditionalReserve() should check for memory limits before allocating memory to IntermediateMemoryToMemoryMerger

[ https://issues.apache.org/jira/browse/TEZ-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-1911: -- Attachment: TEZ-1911.addendum.findbugs.patch line 659 and line 662 were not valid as

Failed: TEZ-3143 PreCommit Build #1522

Jira: https://issues.apache.org/jira/browse/TEZ-3143 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/1522/ ### ## LAST 60 LINES OF THE CONSOLE ###

[jira] [Commented] (TEZ-3140) Reduce AM memory usage while serialization

[ https://issues.apache.org/jira/browse/TEZ-3140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15169940#comment-15169940 ] Jonathan Eagles commented on TEZ-3140: -- The DataInputByteBuffer extends DataInputStream which has these

[jira] [Commented] (TEZ-3140) Reduce AM memory usage while serialization

[ https://issues.apache.org/jira/browse/TEZ-3140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15169901#comment-15169901 ] Jason Lowe commented on TEZ-3140: - There are other cases in Hadoop code where they need to do something

[jira] [Commented] (TEZ-3141) mapreduce.task.timeout is not translated to container heartbeat timeout

[ https://issues.apache.org/jira/browse/TEZ-3141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15169837#comment-15169837 ] Siddharth Seth commented on TEZ-3141: - +1. The property is used in the AM in any case, so the runtime

[jira] [Updated] (TEZ-3128) Avoid stopping containers on the AM shutdown thread

[ https://issues.apache.org/jira/browse/TEZ-3128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated TEZ-3128: Hadoop Flags: Reviewed Fix Version/s: 0.7.1 bq. should this be pulled into 0.7 as well ? Yes, I

[jira] [Commented] (TEZ-3143) Tez UI 2: Make the build faster

[ https://issues.apache.org/jira/browse/TEZ-3143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15169651#comment-15169651 ] Sreenath Somarajapuram commented on TEZ-3143: - Thanks [~hitesh] bq. have you done analysis

[jira] [Commented] (TEZ-1911) MergeManager's unconditionalReserve() should check for memory limits before allocating memory to IntermediateMemoryToMemoryMerger

[ https://issues.apache.org/jira/browse/TEZ-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15169646#comment-15169646 ] Jason Lowe commented on TEZ-1911: - I'll hold off on the cherry-pick to branch-0.7 until the findbugs issue

[jira] [Commented] (TEZ-3091) Tez UI 2: Make tez-ui2 the default UI

[ https://issues.apache.org/jira/browse/TEZ-3091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15169617#comment-15169617 ] Sreenath Somarajapuram commented on TEZ-3091: - tez-ui must be replaced with ui2 only after

[jira] [Commented] (TEZ-3143) Tez UI 2: Make the build faster

[ https://issues.apache.org/jira/browse/TEZ-3143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15169600#comment-15169600 ] Hitesh Shah commented on TEZ-3143: -- Given that this was done to speed up the build time, have you done

[jira] [Commented] (TEZ-3143) Tez UI 2: Make the build faster

[ https://issues.apache.org/jira/browse/TEZ-3143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15169602#comment-15169602 ] Hitesh Shah commented on TEZ-3143: -- Also please use submit patch to ensure that precommit runs against the

[jira] [Updated] (TEZ-3143) Tez UI 2: Make the build faster

[ https://issues.apache.org/jira/browse/TEZ-3143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sreenath Somarajapuram updated TEZ-3143: Description: Current build is taking around a minute, the same must be brought below

[jira] [Updated] (TEZ-3143) Tez UI 2: Make the build faster

[ https://issues.apache.org/jira/browse/TEZ-3143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sreenath Somarajapuram updated TEZ-3143: Attachment: TEZ-3143.1.patch The patch disables minification of CSS & JS assets.

[jira] [Commented] (TEZ-1911) MergeManager's unconditionalReserve() should check for memory limits before allocating memory to IntermediateMemoryToMemoryMerger

[ https://issues.apache.org/jira/browse/TEZ-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15169536#comment-15169536 ] Siddharth Seth commented on TEZ-1911: - According to findbugs {code} Unsynchronized access at

[jira] [Created] (TEZ-3146) Tez UI 2: CSS & JS assets in the UI must be minified

Sreenath Somarajapuram created TEZ-3146: --- Summary: Tez UI 2: CSS & JS assets in the UI must be minified Key: TEZ-3146 URL: https://issues.apache.org/jira/browse/TEZ-3146 Project: Apache Tez

[jira] [Commented] (TEZ-3115) Shuffle string handling adds significant memory overhead

[ https://issues.apache.org/jira/browse/TEZ-3115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15169463#comment-15169463 ] Jonathan Eagles commented on TEZ-3115: -- [~sseth], can you have a review of this patch? The finbugs

[jira] [Commented] (TEZ-3128) Avoid stopping containers on the AM shutdown thread

[ https://issues.apache.org/jira/browse/TEZ-3128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15169448#comment-15169448 ] Siddharth Seth commented on TEZ-3128: - +1. Committing. Thanks [~ozawa]. [~jlowe] - should this be pulled

[jira] [Commented] (TEZ-1911) MergeManager's unconditionalReserve() should check for memory limits before allocating memory to IntermediateMemoryToMemoryMerger

[ https://issues.apache.org/jira/browse/TEZ-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15169442#comment-15169442 ] Siddharth Seth commented on TEZ-1911: - Please go ahead. > MergeManager's unconditionalReserve() should

[jira] [Commented] (TEZ-3077) TezClient.waitTillReady should support timeout

[ https://issues.apache.org/jira/browse/TEZ-3077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15169438#comment-15169438 ] TezQA commented on TEZ-3077: {color:red}-1 overall{color}. Here are the results of testing the latest

Failed: TEZ-3077 PreCommit Build #1521

Jira: https://issues.apache.org/jira/browse/TEZ-3077 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/1521/ ### ## LAST 60 LINES OF THE CONSOLE ###

[jira] [Commented] (TEZ-3115) Shuffle string handling adds significant memory overhead

[ https://issues.apache.org/jira/browse/TEZ-3115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15169414#comment-15169414 ] TezQA commented on TEZ-3115: {color:red}-1 overall{color}. Here are the results of testing the latest

Failed: TEZ-3115 PreCommit Build #1520

Jira: https://issues.apache.org/jira/browse/TEZ-3115 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/1520/ ### ## LAST 60 LINES OF THE CONSOLE ###

[jira] [Commented] (TEZ-2863) Container, node, and logs not available in UI for tasks that fail to launch

[ https://issues.apache.org/jira/browse/TEZ-2863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15169302#comment-15169302 ] Jonathan Eagles commented on TEZ-2863: -- [~zjffdu], can you comment on this jira with regard to

[jira] [Commented] (TEZ-3141) mapreduce.task.timeout is not translated to container heartbeat timeout

[ https://issues.apache.org/jira/browse/TEZ-3141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15169275#comment-15169275 ] TezQA commented on TEZ-3141: {color:red}-1 overall{color}. Here are the results of testing the latest

Failed: TEZ-3141 PreCommit Build #1519

Jira: https://issues.apache.org/jira/browse/TEZ-3141 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/1519/ ### ## LAST 60 LINES OF THE CONSOLE ###

[jira] [Commented] (TEZ-3115) Shuffle string handling adds significant memory overhead

[ https://issues.apache.org/jira/browse/TEZ-3115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15169266#comment-15169266 ] Jonathan Eagles commented on TEZ-3115: -- Patch 2 summary. - Host and attempt are now the fundamental

[jira] [Created] (TEZ-3145) Reduce message size when empty partitions is high

Jonathan Eagles created TEZ-3145: Summary: Reduce message size when empty partitions is high Key: TEZ-3145 URL: https://issues.apache.org/jira/browse/TEZ-3145 Project: Apache Tez Issue Type:

[jira] [Created] (TEZ-3144) Evaluate a lower overhead collection to store large collections

Jonathan Eagles created TEZ-3144: Summary: Evaluate a lower overhead collection to store large collections Key: TEZ-3144 URL: https://issues.apache.org/jira/browse/TEZ-3144 Project: Apache Tez

[jira] [Commented] (TEZ-3128) Avoid stopping containers on the AM shutdown thread

[ https://issues.apache.org/jira/browse/TEZ-3128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15169260#comment-15169260 ] TezQA commented on TEZ-3128: {color:red}-1 overall{color}. Here are the results of testing the latest

Failed: TEZ-3128 PreCommit Build #1518

Jira: https://issues.apache.org/jira/browse/TEZ-3128 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/1518/ ### ## LAST 60 LINES OF THE CONSOLE ###

[jira] [Updated] (TEZ-3115) Shuffle string handling adds significant memory overhead

[ https://issues.apache.org/jira/browse/TEZ-3115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-3115: - Attachment: TEZ-3115.2.patch > Shuffle string handling adds significant memory overhead >

[jira] [Commented] (TEZ-3128) Avoid stopping containers on the AM shutdown thread

[ https://issues.apache.org/jira/browse/TEZ-3128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15169234#comment-15169234 ] TezQA commented on TEZ-3128: {color:red}-1 overall{color}. Here are the results of testing the latest

[jira] [Updated] (TEZ-3103) Shuffle can hang when memory to memory merging enabled

[ https://issues.apache.org/jira/browse/TEZ-3103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated TEZ-3103: Fix Version/s: 0.8.3 > Shuffle can hang when memory to memory merging enabled >

Failed: TEZ-3128 PreCommit Build #1517

Jira: https://issues.apache.org/jira/browse/TEZ-3128 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/1517/ ### ## LAST 60 LINES OF THE CONSOLE ###

[jira] [Commented] (TEZ-1911) MergeManager's unconditionalReserve() should check for memory limits before allocating memory to IntermediateMemoryToMemoryMerger

[ https://issues.apache.org/jira/browse/TEZ-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15169231#comment-15169231 ] Jason Lowe commented on TEZ-1911: - This picks mostly clean to branch-0.7 except for a minor import conflict.

[jira] [Created] (TEZ-3143) Tez UI 2: Make the build faster

Sreenath Somarajapuram created TEZ-3143: --- Summary: Tez UI 2: Make the build faster Key: TEZ-3143 URL: https://issues.apache.org/jira/browse/TEZ-3143 Project: Apache Tez Issue Type:

[jira] [Updated] (TEZ-3141) mapreduce.task.timeout is not translated to container heartbeat timeout

[ https://issues.apache.org/jira/browse/TEZ-3141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated TEZ-3141: Attachment: TEZ-3141.002.patch I believe Pig does use the DAG key map directly. [~rohini] can clarify. As

[jira] [Updated] (TEZ-3128) Avoid stopping containers on the AM shutdown thread

[ https://issues.apache.org/jira/browse/TEZ-3128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa updated TEZ-3128: Attachment: TEZ-3128.004.patch Attaching v04 patch to remove a needless comment. > Avoid stopping

[jira] [Commented] (TEZ-3128) Avoid stopping containers on the AM shutdown thread

[ https://issues.apache.org/jira/browse/TEZ-3128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15169083#comment-15169083 ] Tsuyoshi Ozawa commented on TEZ-3128: - Attached v03 patch to address the comment. > Avoid stopping