Success: TEZ-3437 PreCommit Build #2004

2016-09-30 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-3437 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/2004/ ### ## LAST 60 LINES OF THE CONSOLE ###

[jira] [Commented] (TEZ-3437) Improve synchronization and the progress report behavior for Inputs from TEZ-3317

2016-09-30 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537262#comment-15537262 ] TezQA commented on TEZ-3437: {color:green}+1 overall{color}. Here are the results of testing the latest

[jira] [Updated] (TEZ-3362) Delete intermediate data at DAG level for Shuffle Handler

2016-09-30 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated TEZ-3362: - Attachment: TEZ-3362.006.patch Addressed the 2 comments on the patch by [~sseth]. Needed to take out the

Success: TEZ-3432 PreCommit Build #2003

2016-09-30 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-3432 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/2003/ ### ## LAST 60 LINES OF THE CONSOLE ###

[jira] [Commented] (TEZ-3432) Add unit test for session timeout

2016-09-30 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15536965#comment-15536965 ] TezQA commented on TEZ-3432: {color:green}+1 overall{color}. Here are the results of testing the latest

[jira] [Updated] (TEZ-3437) Improve synchronization and the progress report behavior for Inputs from TEZ-3317

2016-09-30 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated TEZ-3437: - Attachment: TEZ-3437.008.patch Addressed comments from [~sseth] but left {{setProgress}} as it was in the

Failed: TEZ-3452 PreCommit Build #2002

2016-09-30 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-3452 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/2002/ ### ## LAST 60 LINES OF THE CONSOLE ###

[jira] [Commented] (TEZ-3452) Auto-reduce parallelism calculation can overflow with large inputs

2016-09-30 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15536892#comment-15536892 ] TezQA commented on TEZ-3452: {color:red}-1 overall{color}. Here are the results of testing the latest

[jira] [Commented] (TEZ-3437) Improve synchronization and the progress report behavior for Inputs from TEZ-3317

2016-09-30 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15536732#comment-15536732 ] Kuhu Shukla commented on TEZ-3437: -- {quote} Thinking about this some more, I really don't like the idea of

[jira] [Commented] (TEZ-3362) Delete intermediate data at DAG level for Shuffle Handler

2016-09-30 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15536590#comment-15536590 ] Kuhu Shukla commented on TEZ-3362: -- bq. 1. dagDeleteService - if I'm not mistaken this is setup each time a

[jira] [Commented] (TEZ-3362) Delete intermediate data at DAG level for Shuffle Handler

2016-09-30 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15536556#comment-15536556 ] Siddharth Seth commented on TEZ-3362: - The dagComplete notification that goes out to the ServicePlugins

[jira] [Commented] (TEZ-3437) Improve synchronization and the progress report behavior for Inputs from TEZ-3317

2016-09-30 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15536522#comment-15536522 ] Siddharth Seth commented on TEZ-3437: - bq. Thank you so much Siddharth Seth for the quick and detailed

[jira] [Commented] (TEZ-3362) Delete intermediate data at DAG level for Shuffle Handler

2016-09-30 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15536448#comment-15536448 ] Hitesh Shah commented on TEZ-3362: -- bq. The DagAppMaster will initialize this "Deletion Service" in a

[jira] [Comment Edited] (TEZ-3362) Delete intermediate data at DAG level for Shuffle Handler

2016-09-30 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15536443#comment-15536443 ] Hitesh Shah edited comment on TEZ-3362 at 9/30/16 4:47 PM: --- Sounds good. I would

[jira] [Commented] (TEZ-3362) Delete intermediate data at DAG level for Shuffle Handler

2016-09-30 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15536443#comment-15536443 ] Hitesh Shah commented on TEZ-3362: -- Sounds good. I would separate path based deletion and service plugin

[jira] [Commented] (TEZ-3362) Delete intermediate data at DAG level for Shuffle Handler

2016-09-30 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15536352#comment-15536352 ] Kuhu Shukla commented on TEZ-3362: -- [~hitesh], we can move the generic service plugin effort, which would

[jira] [Commented] (TEZ-3440) Shuffling to memory can get out-of-sync when fetching multiple compressed map outputs

2016-09-30 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15536211#comment-15536211 ] Nathan Roberts commented on TEZ-3440: - Verified the fix resolved the problem for a large job that was

[jira] [Assigned] (TEZ-3455) Using TEZ_RUNTIME_IO_FILE_BUFFER_SIZE to replace "io.file.buffer.size"

2016-09-30 Thread darion yaphet (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] darion yaphet reassigned TEZ-3455: -- Assignee: darion yaphet > Using TEZ_RUNTIME_IO_FILE_BUFFER_SIZE to replace "io.file.buffer.size"

[jira] [Created] (TEZ-3455) Using TEZ_RUNTIME_IO_FILE_BUFFER_SIZE to replace "io.file.buffer.size"

2016-09-30 Thread darion yaphet (JIRA)
darion yaphet created TEZ-3455: -- Summary: Using TEZ_RUNTIME_IO_FILE_BUFFER_SIZE to replace "io.file.buffer.size" Key: TEZ-3455 URL: https://issues.apache.org/jira/browse/TEZ-3455 Project: Apache Tez

Failed: TEZ-3428 PreCommit Build #2001

2016-09-30 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-3428 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/2001/ ### ## LAST 60 LINES OF THE CONSOLE ###

[jira] [Commented] (TEZ-3428) Tez UI: First Tab not needed for few entries in DAG listings

2016-09-30 Thread Sreenath Somarajapuram (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15535698#comment-15535698 ] Sreenath Somarajapuram commented on TEZ-3428: - [~harishjp] That was just a duplicate message.

[jira] [Updated] (TEZ-3428) Tez UI: First Tab not needed for few entries in DAG listings

2016-09-30 Thread Sreenath Somarajapuram (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sreenath Somarajapuram updated TEZ-3428: Attachment: Screen-Shot-2016-09-30-at-3.10.00-PM.jpg > Tez UI: First Tab not needed

[jira] [Updated] (TEZ-3428) Tez UI: First Tab not needed for few entries in DAG listings

2016-09-30 Thread Sreenath Somarajapuram (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sreenath Somarajapuram updated TEZ-3428: Attachment: (was: Screen Shot 2016-09-30 at 3.10.00 PM.png) > Tez UI: First Tab

Failed: TEZ-3428 PreCommit Build #2000

2016-09-30 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-3428 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/2000/ ### ## LAST 60 LINES OF THE CONSOLE ###

[jira] [Commented] (TEZ-3428) Tez UI: First Tab not needed for few entries in DAG listings

2016-09-30 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15535562#comment-15535562 ] TezQA commented on TEZ-3428: {color:red}-1 overall{color}. Here are the results of testing the latest

[jira] [Updated] (TEZ-3428) Tez UI: First Tab not needed for few entries in DAG listings

2016-09-30 Thread Sreenath Somarajapuram (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sreenath Somarajapuram updated TEZ-3428: Attachment: Screen Shot 2016-09-30 at 3.10.00 PM.png > Tez UI: First Tab not needed