[jira] [Commented] (TEZ-3198) Shuffle failures for the trailing task in a vertex are often fatal to the entire DAG

2016-04-07 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15230263#comment-15230263 ] Jason Lowe commented on TEZ-3198: - Note it's not just for 500 internal server errors, as we've seen this

[jira] [Commented] (TEZ-3198) Shuffle failures for the trailing task in a vertex are often fatal to the entire DAG

2016-04-07 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15230335#comment-15230335 ] Rajesh Balamohan commented on TEZ-3198: --- That is correct. I took the example of 500 internal server

[jira] [Updated] (TEZ-3202) Reduce the memory need for jobs with high number of segments

2016-04-07 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-3202: - Attachment: TEZ-3202.3.patch > Reduce the memory need for jobs with high number of segments >

[jira] [Commented] (TEZ-3196) java.lang.InternalError from decompression codec is fatal to a task during shuffle

2016-04-07 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15230100#comment-15230100 ] TezQA commented on TEZ-3196: {color:red}-1 overall{color}. Here are the results of testing the latest

[jira] [Updated] (TEZ-3203) DAG hangs when one of the upstream vertices has zero tasks

2016-04-07 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated TEZ-3203: Attachment: TEZ-3203.001.patch Patch to have the shuffle vertex manager go ahead and schedule zero tasks (and

[jira] [Commented] (TEZ-3188) Move tez.submit.hosts out of TezConfiguration

2016-04-07 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15230706#comment-15230706 ] Siddharth Seth commented on TEZ-3188: - Since these config properties are marked as private - the

[jira] [Commented] (TEZ-3188) Move tez.submit.hosts out of TezConfiguration

2016-04-07 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15230713#comment-15230713 ] Hitesh Shah commented on TEZ-3188: -- TezConfigurationConstants is fine by me. A description mentioning that

[jira] [Commented] (TEZ-3188) Move tez.submit.hosts out of TezConfiguration

2016-04-07 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15230711#comment-15230711 ] Hitesh Shah commented on TEZ-3188: -- Shouldnt be empty if @ConfigurationProperty is set. > Move

[jira] [Updated] (TEZ-3188) Move tez.submit.hosts out of TezConfiguration

2016-04-07 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-3188: Attachment: TEZ-3188.3.txt Updated patch. Back to TezConstants. The ConfigurationProperty annotation

[jira] [Commented] (TEZ-3198) Shuffle failures for the trailing task in a vertex are often fatal to the entire DAG

2016-04-07 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15230773#comment-15230773 ] Bikas Saha commented on TEZ-3198: - Yes. Looks like our defaults can be better for real life workloads. >

[jira] [Commented] (TEZ-3120) Remove TaskCommContext.getCurrentDagName, Identifier

2016-04-07 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15230680#comment-15230680 ] Siddharth Seth commented on TEZ-3120: - +1. Committing. Thanks [~ozawa] > Remove

[jira] [Issue Comment Deleted] (TEZ-3202) Reduce the memory need for jobs with high number of segments

2016-04-07 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-3202: - Comment: was deleted (was: {color:red}-1 overall{color}. Here are the results of testing the

[jira] [Issue Comment Deleted] (TEZ-3202) Reduce the memory need for jobs with high number of segments

2016-04-07 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-3202: - Comment: was deleted (was: {color:red}-1 overall{color}. Here are the results of testing the

[jira] [Commented] (TEZ-3203) DAG hangs when one of the upstream vertices has zero tasks

2016-04-07 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15231014#comment-15231014 ] Jason Lowe commented on TEZ-3203: - The hang occurs because the downstream vertex with multiple inputs never

[jira] [Updated] (TEZ-3180) Update master docs to declare hadoop-2.6.x as a minimum requirement

2016-04-07 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-3180: - Attachment: TEZ-3180.1.patch Initial doc only patch. pom cleanup and code cleanup can happen in follow-ups.

[jira] [Created] (TEZ-3203) DAG hangs when one of the upstream vertices has zero tasks

2016-04-07 Thread Jason Lowe (JIRA)
Jason Lowe created TEZ-3203: --- Summary: DAG hangs when one of the upstream vertices has zero tasks Key: TEZ-3203 URL: https://issues.apache.org/jira/browse/TEZ-3203 Project: Apache Tez Issue Type:

[jira] [Commented] (TEZ-3188) Move tez.submit.hosts out of TezConfiguration

2016-04-07 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15230919#comment-15230919 ] TezQA commented on TEZ-3188: {color:red}-1 overall{color}. Here are the results of testing the latest

Failed: TEZ-3188 PreCommit Build #1634

2016-04-07 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-3188 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/1634/ ### ## LAST 60 LINES OF THE CONSOLE ###

Failed: TEZ-3202 PreCommit Build #1635

2016-04-07 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-3202 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/1635/ ### ## LAST 60 LINES OF THE CONSOLE ###

[jira] [Commented] (TEZ-3202) Reduce the memory need for jobs with high number of segments

2016-04-07 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15231145#comment-15231145 ] Jonathan Eagles commented on TEZ-3202: -- [~rajesh.balamohan], Can you have a look at this change? This

[jira] [Commented] (TEZ-3180) Update master docs to declare hadoop-2.6.x as a minimum requirement

2016-04-07 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15231445#comment-15231445 ] Siddharth Seth commented on TEZ-3180: - +1 > Update master docs to declare hadoop-2.6.x as a minimum

Success: TEZ-3203 PreCommit Build #1637

2016-04-07 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-3203 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/1637/ ### ## LAST 60 LINES OF THE CONSOLE ###

[jira] [Commented] (TEZ-3203) DAG hangs when one of the upstream vertices has zero tasks

2016-04-07 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15231364#comment-15231364 ] TezQA commented on TEZ-3203: {color:green}+1 overall{color}. Here are the results of testing the latest

[jira] [Updated] (TEZ-3188) Move tez.submit.hosts out of TezConfiguration

2016-04-07 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-3188: Attachment: TEZ-3188.2.txt Renamed to TezConfigurationPublished - still open to better names. Tried

Failed: TEZ-3188 PreCommit Build #1626

2016-04-07 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-3188 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/1626/ ### ## LAST 60 LINES OF THE CONSOLE ###

[jira] [Commented] (TEZ-3201) Tez-UI build broken

2016-04-07 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15229901#comment-15229901 ] Siddharth Seth commented on TEZ-3201: - Thanks [~Sreenath] - starting the pending pre-commit builds. >

[jira] [Commented] (TEZ-3201) Tez-UI build broken

2016-04-07 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15229877#comment-15229877 ] Siddharth Seth commented on TEZ-3201: - Tried the patch locally, and this fixes my local build. The

[jira] [Commented] (TEZ-3188) Move tez.submit.hosts out of TezConfiguration

2016-04-07 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15229893#comment-15229893 ] TezQA commented on TEZ-3188: {color:red}-1 overall{color}. Here are the results of testing the latest

[jira] [Commented] (TEZ-3201) Tez-UI build broken

2016-04-07 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15229906#comment-15229906 ] Siddharth Seth commented on TEZ-3201: - [~Sreenath] - I think the fix will be needed on branch-0.7 as

[jira] [Updated] (TEZ-3201) Tez-UI build broken

2016-04-07 Thread Sreenath Somarajapuram (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sreenath Somarajapuram updated TEZ-3201: Attachment: TEZ-3201.2.patch Attaching a patch with the LICENSE change. > Tez-UI

[jira] [Commented] (TEZ-3074) Multithreading issue java.lang.ArrayIndexOutOfBoundsException: -1 while working with Tez

2016-04-07 Thread Alina Abramova (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15230029#comment-15230029 ] Alina Abramova commented on TEZ-3074: - After my investigating work I see that cause of this issue is

[jira] [Commented] (TEZ-3202) Reduce the memory need for jobs with high number of segments

2016-04-07 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15231122#comment-15231122 ] TezQA commented on TEZ-3202: {color:red}-1 overall{color}. Here are the results of testing the latest

[jira] [Commented] (TEZ-3203) DAG hangs when one of the upstream vertices has zero tasks

2016-04-07 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15231460#comment-15231460 ] Bikas Saha commented on TEZ-3203: - Good catch! Maybe we can get away with removing the numpendingtasks

[jira] [Commented] (TEZ-3188) Move tez.submit.hosts out of TezConfiguration

2016-04-07 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15231472#comment-15231472 ] Hitesh Shah commented on TEZ-3188: -- +1 > Move tez.submit.hosts out of TezConfiguration >

Success: TEZ-3188 PreCommit Build #1638

2016-04-07 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-3188 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/1638/ ### ## LAST 60 LINES OF THE CONSOLE ###

[jira] [Commented] (TEZ-3188) Move tez.submit.hosts out of TezConfiguration

2016-04-07 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15231514#comment-15231514 ] TezQA commented on TEZ-3188: {color:green}+1 overall{color}. Here are the results of testing the latest

Failed: TEZ-3199 PreCommit Build #1630

2016-04-07 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-3199 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/1630/ ### ## LAST 60 LINES OF THE CONSOLE ###

[jira] [Commented] (TEZ-3199) Rename getCredentials in TaskCommunicatorContext to be less confusing

2016-04-07 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15230095#comment-15230095 ] TezQA commented on TEZ-3199: {color:red}-1 overall{color}. Here are the results of testing the latest

Failed: TEZ-3188 PreCommit Build #1629

2016-04-07 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-3188 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/1629/ ### ## LAST 60 LINES OF THE CONSOLE ###

[jira] [Commented] (TEZ-3188) Move tez.submit.hosts out of TezConfiguration

2016-04-07 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15230062#comment-15230062 ] TezQA commented on TEZ-3188: {color:red}-1 overall{color}. Here are the results of testing the latest