[jira] [Commented] (TEZ-3479) DAG AM does not schedule any more containers in corner cases

2016-10-18 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587501#comment-15587501 ] Rajesh Balamohan commented on TEZ-3479: --- That is correct. Haven't observed this in other cases. > DAG

[jira] [Updated] (TEZ-3419) Tez UI: Applications page shows error, for users with only DAG level ACL permission.

2016-10-18 Thread Sreenath Somarajapuram (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sreenath Somarajapuram updated TEZ-3419: Attachment: TEZ-3419.6.patch Thanks [~hitesh] bq. 2 screenshots show spurious data

[jira] [Created] (TEZ-3475) Merge duplicated method into base class

2016-10-18 Thread darion yaphet (JIRA)
darion yaphet created TEZ-3475: -- Summary: Merge duplicated method into base class Key: TEZ-3475 URL: https://issues.apache.org/jira/browse/TEZ-3475 Project: Apache Tez Issue Type: Bug

[jira] [Commented] (TEZ-3475) Merge duplicated method into base class

2016-10-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15585388#comment-15585388 ] ASF GitHub Bot commented on TEZ-3475: - GitHub user darionyaphet opened a pull request:

Success: TEZ-3419 PreCommit Build #2043

2016-10-18 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-3419 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/2043/ ### ## LAST 60 LINES OF THE CONSOLE ###

[jira] [Commented] (TEZ-3419) Tez UI: Applications page shows error, for users with only DAG level ACL permission.

2016-10-18 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15585304#comment-15585304 ] TezQA commented on TEZ-3419: {color:green}+1 overall{color}. Here are the results of testing the latest

[jira] [Updated] (TEZ-3458) Auto grouping for cartesian product edge(unpartitioned case)

2016-10-18 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhiyuan Yang updated TEZ-3458: -- Attachment: TEZ-3458.2.patch > Auto grouping for cartesian product edge(unpartitioned case) >

[jira] [Commented] (TEZ-3452) Auto-reduce parallelism calculation can overflow with large inputs

2016-10-18 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15585906#comment-15585906 ] Ming Ma commented on TEZ-3452: -- +1. Thanks [~jeagles]. > Auto-reduce parallelism calculation can overflow with

[jira] [Commented] (TEZ-3458) Auto grouping for cartesian product edge(unpartitioned case)

2016-10-18 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15586045#comment-15586045 ] TezQA commented on TEZ-3458: {color:red}-1 overall{color}. Here are the results of testing the latest

Failed: TEZ-3458 PreCommit Build #2044

2016-10-18 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-3458 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/2044/ ### ## LAST 60 LINES OF THE CONSOLE ###

[jira] [Created] (TEZ-3477) MRInputHelpers generateInputSplitsToMem public API modified

2016-10-18 Thread Jonathan Eagles (JIRA)
Jonathan Eagles created TEZ-3477: Summary: MRInputHelpers generateInputSplitsToMem public API modified Key: TEZ-3477 URL: https://issues.apache.org/jira/browse/TEZ-3477 Project: Apache Tez

[jira] [Updated] (TEZ-3477) MRInputHelpers generateInputSplitsToMem public API modified

2016-10-18 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-3477: - Attachment: TEZ-3477.1.patch > MRInputHelpers generateInputSplitsToMem public API modified >

[jira] [Created] (TEZ-3476) Need a way to account for container localization.

2016-10-18 Thread Eric Payne (JIRA)
Eric Payne created TEZ-3476: --- Summary: Need a way to account for container localization. Key: TEZ-3476 URL: https://issues.apache.org/jira/browse/TEZ-3476 Project: Apache Tez Issue Type: Bug

[jira] [Commented] (TEZ-3477) MRInputHelpers generateInputSplitsToMem public API modified

2016-10-18 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15586551#comment-15586551 ] Hitesh Shah commented on TEZ-3477: -- Might be good to add backward compatible functions to account for the

[jira] [Updated] (TEZ-3419) Tez UI: Applications page shows error, for users with only DAG level ACL permission.

2016-10-18 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-3419: - Target Version/s: 0.8.5 (was: 0.9.0) > Tez UI: Applications page shows error, for users with only DAG

[jira] [Commented] (TEZ-3419) Tez UI: Applications page shows error, for users with only DAG level ACL permission.

2016-10-18 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15586674#comment-15586674 ] Hitesh Shah commented on TEZ-3419: -- +1 > Tez UI: Applications page shows error, for users with only DAG

[jira] [Updated] (TEZ-3458) Auto grouping for cartesian product edge(unpartitioned case)

2016-10-18 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhiyuan Yang updated TEZ-3458: -- Summary: Auto grouping for cartesian product edge(unpartitioned case) (was: Auto reduce for cartesian

[jira] [Updated] (TEZ-3458) Auto grouping for cartesian product edge(unpartitioned case)

2016-10-18 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhiyuan Yang updated TEZ-3458: -- Attachment: TEZ-3458.1.patch > Auto grouping for cartesian product edge(unpartitioned case) >

Failed: TEZ-3458 PreCommit Build #2042

2016-10-18 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-3458 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/2042/ ### ## LAST 60 LINES OF THE CONSOLE ###

[jira] [Commented] (TEZ-3458) Auto grouping for cartesian product edge(unpartitioned case)

2016-10-18 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15584716#comment-15584716 ] TezQA commented on TEZ-3458: {color:red}-1 overall{color}. Here are the results of testing the latest

[jira] [Commented] (TEZ-3405) Support ability for AM to kill itself if there is no client heartbeating to it

2016-10-18 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15586778#comment-15586778 ] Hitesh Shah commented on TEZ-3405: -- ping [~sseth] - please help with hopefully a final review whenever you

[jira] [Commented] (TEZ-3462) Task attempt failure during container shutdown loses useful container diagnostics

2016-10-18 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15586783#comment-15586783 ] Hitesh Shah commented on TEZ-3462: -- bq. complicated to handle ... since the ATS publish would already have

[jira] [Commented] (TEZ-3439) Tez joinvalidate example failed when first input argument size is bigger than the second

2016-10-18 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15586823#comment-15586823 ] Hitesh Shah commented on TEZ-3439: -- +1. Committing shortly. > Tez joinvalidate example failed when first

[jira] [Updated] (TEZ-3439) Tez joinvalidate fails when first input argument size is bigger than the second

2016-10-18 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-3439: - Summary: Tez joinvalidate fails when first input argument size is bigger than the second (was: Tez

[jira] [Created] (TEZ-3479) DAG AM does not schedule any more containers in corner cases

2016-10-18 Thread Rajesh Balamohan (JIRA)
Rajesh Balamohan created TEZ-3479: - Summary: DAG AM does not schedule any more containers in corner cases Key: TEZ-3479 URL: https://issues.apache.org/jira/browse/TEZ-3479 Project: Apache Tez

[jira] [Updated] (TEZ-3458) Auto grouping for cartesian product edge(unpartitioned case)

2016-10-18 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhiyuan Yang updated TEZ-3458: -- Attachment: TEZ-3458.3.patch > Auto grouping for cartesian product edge(unpartitioned case) >

[jira] [Commented] (TEZ-3477) MRInputHelpers generateInputSplitsToMem public API modified

2016-10-18 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587215#comment-15587215 ] Hitesh Shah commented on TEZ-3477: -- [~jeagles] The change seems straightforward. Do we want to change APIs

Success: TEZ-3465 PreCommit Build #2045

2016-10-18 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-3465 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/2045/ ### ## LAST 60 LINES OF THE CONSOLE ###

[jira] [Commented] (TEZ-3465) Support broadcast edge into cartesian product vertex and forbid other edges

2016-10-18 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587305#comment-15587305 ] TezQA commented on TEZ-3465: {color:green}+1 overall{color}. Here are the results of testing the latest

[jira] [Comment Edited] (TEZ-3479) DAG AM does not schedule any more containers in corner cases

2016-10-18 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587023#comment-15587023 ] Hitesh Shah edited comment on TEZ-3479 at 10/18/16 11:31 PM: - Atleast for this

[jira] [Updated] (TEZ-3465) Support broadcast edge into cartesian product vertex and forbid other edges

2016-10-18 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhiyuan Yang updated TEZ-3465: -- Attachment: TEZ-3465.3.patch > Support broadcast edge into cartesian product vertex and forbid other

[jira] [Commented] (TEZ-3478) Cleanup fetcher data for failing task attempts (Unordered fetcher)

2016-10-18 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15586962#comment-15586962 ] Hitesh Shah commented on TEZ-3478: -- Is this only an issue with unordered data? > Cleanup fetcher data for

[jira] [Created] (TEZ-3478) Cleanup fetcher data for failing task attempts (Unordered fetcher)

2016-10-18 Thread Rajesh Balamohan (JIRA)
Rajesh Balamohan created TEZ-3478: - Summary: Cleanup fetcher data for failing task attempts (Unordered fetcher) Key: TEZ-3478 URL: https://issues.apache.org/jira/browse/TEZ-3478 Project: Apache Tez

[jira] [Commented] (TEZ-3479) DAG AM does not schedule any more containers in corner cases

2016-10-18 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15586998#comment-15586998 ] Rajesh Balamohan commented on TEZ-3479: --- [~hitesh] - I haven't disabled recovery in my runs. Will

[jira] [Commented] (TEZ-3479) DAG AM does not schedule any more containers in corner cases

2016-10-18 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587378#comment-15587378 ] Hitesh Shah commented on TEZ-3479: -- bq. I haven't disabled recovery in my runs. To clarify, my question

[jira] [Commented] (TEZ-3479) DAG AM does not schedule any more containers in corner cases

2016-10-18 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587023#comment-15587023 ] Hitesh Shah commented on TEZ-3479: -- Atleast for this scenario, I think we did not recover

[jira] [Updated] (TEZ-3479) DAG AM does not schedule any more containers in corner cases

2016-10-18 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-3479: -- Affects Version/s: 0.7.1 > DAG AM does not schedule any more containers in corner cases >

[jira] [Commented] (TEZ-3479) DAG AM does not schedule any more containers in corner cases

2016-10-18 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15586992#comment-15586992 ] Hitesh Shah commented on TEZ-3479: -- [~rajesh.balamohan] Is this happening only in the cases where the AM

[jira] [Commented] (TEZ-3405) Support ability for AM to kill itself if there is no client heartbeating to it

2016-10-18 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587218#comment-15587218 ] Siddharth Seth commented on TEZ-3405: - +1. > Support ability for AM to kill itself if there is no

[jira] [Updated] (TEZ-3479) DAG AM does not schedule any more containers in corner cases

2016-10-18 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-3479: -- Attachment: application_1476667862449_0031_not_complete.1.log.tar.gz > DAG AM does not schedule

[jira] [Commented] (TEZ-3478) Cleanup fetcher data for failing task attempts (Unordered fetcher)

2016-10-18 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15586993#comment-15586993 ] Rajesh Balamohan commented on TEZ-3478: --- Haven't checked for ordered case yet, but should be present