[jira] [Commented] (TEZ-3294) Resubmitted dag fails with IllegalArgumentException, when there is a javaOptsCheck error.

2016-06-09 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15322677#comment-15322677 ] Hitesh Shah commented on TEZ-3294: -- Changes look good for the most part. However, given that this change

[jira] [Comment Edited] (TEZ-3291) Optimize splits grouping when locality information is not available

2016-06-09 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15322839#comment-15322839 ] Hitesh Shah edited comment on TEZ-3291 at 6/9/16 5:25 PM: -- bq. Generating random

[jira] [Commented] (TEZ-3295) Tez Example MRRSleep job should handle relative path as Input

2016-06-09 Thread Sushmitha Sreenivasan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323063#comment-15323063 ] Sushmitha Sreenivasan commented on TEZ-3295: [~harishjp] Can you please review the patch and let

[jira] [Commented] (TEZ-3291) Optimize splits grouping when locality information is not available

2016-06-09 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323264#comment-15323264 ] Bikas Saha commented on TEZ-3291: - I will take a quick look at the patch by EOD. Looks like the main issue

[jira] [Created] (TEZ-3296) Tez job can hang if two vertices at the same root distance have different task requirements

2016-06-09 Thread Jason Lowe (JIRA)
Jason Lowe created TEZ-3296: --- Summary: Tez job can hang if two vertices at the same root distance have different task requirements Key: TEZ-3296 URL: https://issues.apache.org/jira/browse/TEZ-3296 Project:

[jira] [Updated] (TEZ-3295) Tez Example MRRSleep job should handle relative path as Input

2016-06-09 Thread Sushmitha Sreenivasan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sushmitha Sreenivasan updated TEZ-3295: --- Attachment: Tez-3295.1.patch > Tez Example MRRSleep job should handle relative path as

[jira] [Commented] (TEZ-3295) Tez Example MRRSleep job should handle relative path as Input

2016-06-09 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323157#comment-15323157 ] Hitesh Shah commented on TEZ-3295: -- Other minor comments: - line 375 is not needed - FileSystem

[jira] [Comment Edited] (TEZ-3291) Optimize splits grouping when locality information is not available

2016-06-09 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15322839#comment-15322839 ] Hitesh Shah edited comment on TEZ-3291 at 6/9/16 7:24 PM: -- bq. Generating random

[jira] [Comment Edited] (TEZ-3291) Optimize splits grouping when locality information is not available

2016-06-09 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15322839#comment-15322839 ] Hitesh Shah edited comment on TEZ-3291 at 6/9/16 7:24 PM: -- bq. Generating random

[jira] [Commented] (TEZ-3295) Tez Example MRRSleep job should handle relative path as Input

2016-06-09 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323213#comment-15323213 ] TezQA commented on TEZ-3295: {color:green}+1 overall{color}. Here are the results of testing the latest

[jira] [Created] (TEZ-3295) Tez Example MRRSleep job should handle relative path as Input

2016-06-09 Thread Sushmitha Sreenivasan (JIRA)
Sushmitha Sreenivasan created TEZ-3295: -- Summary: Tez Example MRRSleep job should handle relative path as Input Key: TEZ-3295 URL: https://issues.apache.org/jira/browse/TEZ-3295 Project: Apache

[jira] [Commented] (TEZ-3295) Tez Example MRRSleep job should handle relative path as Input

2016-06-09 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323152#comment-15323152 ] Hitesh Shah commented on TEZ-3295: -- [~ssreenivasan] Thanks for the patch. The same change is also needed

[jira] [Updated] (TEZ-3297) Deadlock scenario in AM during ShuffleVertexManager auto reduce

2016-06-09 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhiyuan Yang updated TEZ-3297: -- Attachment: am_log thread_dump > Deadlock scenario in AM during ShuffleVertexManager auto

[jira] [Updated] (TEZ-3295) Tez Example MRRSleep job should handle relative path as Input

2016-06-09 Thread Sushmitha Sreenivasan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sushmitha Sreenivasan updated TEZ-3295: --- Attachment: Tez-3295.2.patch > Tez Example MRRSleep job should handle relative path as

[jira] [Commented] (TEZ-3291) Optimize splits grouping when locality information is not available

2016-06-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323031#comment-15323031 ] Steve Loughran commented on TEZ-3291: - I don't see any problem with adding fake locations; we know that

[jira] [Commented] (TEZ-3296) Tez job can hang if two vertices at the same root distance have different task requirements

2016-06-09 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323618#comment-15323618 ] Gopal V commented on TEZ-3296: -- [~jlowe]: converting the Vertex priorities from partially ordered to full

[jira] [Commented] (TEZ-2215) TezMerger$MergeQueue.next() should not invoke org.apache.commons.logging.impl.Log4JLogger.debug()

2016-06-09 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323622#comment-15323622 ] Gopal V commented on TEZ-2215: -- debug() will check log level of all appenders in a synchronized block - the

[jira] [Updated] (TEZ-3295) Tez Example MRRSleep job should handle relative path as Input

2016-06-09 Thread Sushmitha Sreenivasan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sushmitha Sreenivasan updated TEZ-3295: --- Attachment: Tez-3235.2.patch > Tez Example MRRSleep job should handle relative path as

[jira] [Updated] (TEZ-3295) Tez Example MRRSleep job should handle relative path as Input

2016-06-09 Thread Sushmitha Sreenivasan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sushmitha Sreenivasan updated TEZ-3295: --- Attachment: (was: Tez-3235.2.patch) > Tez Example MRRSleep job should handle

[jira] [Updated] (TEZ-3296) Tez job can hang if two vertices at the same root distance have different task requirements

2016-06-09 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated TEZ-3296: Attachment: TEZ-3296.001.patch Patch that changes the container priority calculations to generate a unique

Failed: TEZ-3296 PreCommit Build #1782

2016-06-09 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-3296 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/1782/ ### ## LAST 60 LINES OF THE CONSOLE ###

[jira] [Commented] (TEZ-3296) Tez job can hang if two vertices at the same root distance have different task requirements

2016-06-09 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323526#comment-15323526 ] TezQA commented on TEZ-3296: {color:red}-1 overall{color}. Here are the results of testing the latest

[jira] [Created] (TEZ-3297) Deadlock scenario in AM during ShuffleVertexManager auto reduce

2016-06-09 Thread Zhiyuan Yang (JIRA)
Zhiyuan Yang created TEZ-3297: - Summary: Deadlock scenario in AM during ShuffleVertexManager auto reduce Key: TEZ-3297 URL: https://issues.apache.org/jira/browse/TEZ-3297 Project: Apache Tez

Failed: TEZ-3296 PreCommit Build #1783

2016-06-09 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-3296 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/1783/ ### ## LAST 60 LINES OF THE CONSOLE ###

[jira] [Commented] (TEZ-3296) Tez job can hang if two vertices at the same root distance have different task requirements

2016-06-09 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323552#comment-15323552 ] TezQA commented on TEZ-3296: {color:red}-1 overall{color}. Here are the results of testing the latest

Success: TEZ-3295 PreCommit Build #1784

2016-06-09 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-3295 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/1784/ ### ## LAST 60 LINES OF THE CONSOLE ###

[jira] [Commented] (TEZ-3295) Tez Example MRRSleep job should handle relative path as Input

2016-06-09 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323725#comment-15323725 ] TezQA commented on TEZ-3295: {color:green}+1 overall{color}. Here are the results of testing the latest

[jira] [Commented] (TEZ-3295) Tez Example MRRSleep job should handle relative path as Input

2016-06-09 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323746#comment-15323746 ] TezQA commented on TEZ-3295: {color:red}-1 overall{color}. Here are the results of testing the latest

Failed: TEZ-3295 PreCommit Build #1785

2016-06-09 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-3295 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/1785/ ### ## LAST 60 LINES OF THE CONSOLE ###

[jira] [Updated] (TEZ-3297) Deadlock scenario in AM during ShuffleVertexManager auto reduce

2016-06-09 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-3297: -- Attachment: TEZ-3297.1.patch > Deadlock scenario in AM during ShuffleVertexManager auto reduce >

[jira] [Commented] (TEZ-3297) Deadlock scenario in AM during ShuffleVertexManager auto reduce

2016-06-09 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323734#comment-15323734 ] Rajesh Balamohan commented on TEZ-3297: --- Attaching .1 patch for review. > Deadlock scenario in AM

[jira] [Commented] (TEZ-3295) Tez Example MRRSleep job should handle relative path as Input

2016-06-09 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323707#comment-15323707 ] Hitesh Shah commented on TEZ-3295: -- +1. Will commit as soon as pre-commit comes back. > Tez Example

[jira] [Commented] (TEZ-3297) Deadlock scenario in AM during ShuffleVertexManager auto reduce

2016-06-09 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323836#comment-15323836 ] Siddharth Seth commented on TEZ-3297: - This looks good to me. The readLock to obtain information from

Success: TEZ-3295 PreCommit Build #1781

2016-06-09 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-3295 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/1781/ ### ## LAST 60 LINES OF THE CONSOLE ###

[jira] [Commented] (TEZ-3291) Optimize splits grouping when locality information is not available

2016-06-09 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15322839#comment-15322839 ] Hitesh Shah commented on TEZ-3291: -- bq. Generating random location can be addressed [~rajesh.balamohan] My

[jira] [Commented] (TEZ-3291) Optimize splits grouping when locality information is not available

2016-06-09 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15322781#comment-15322781 ] Rajesh Balamohan commented on TEZ-3291: --- [~bikassaha] - The fix is the single line check in