[jira] [Updated] (TEZ-3375) Logging with slf4j way instead of "+" to reduce logging overhead

2016-07-25 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa updated TEZ-3375: Description: Currently, Tez ATSv1.5 uses concatenation of Strings instead using placeholders {} which

[jira] [Updated] (TEZ-3375) Logging with slf4j way instead of "+" to reduce logging overhead

2016-07-25 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa updated TEZ-3375: Attachment: TEZ-3375.001.patch Attaching a patch. > Logging with slf4j way instead of "+" to reduce

[jira] [Created] (TEZ-3375) Logging with slf4j way instead of "+" to reduce logging overhead

2016-07-25 Thread Tsuyoshi Ozawa (JIRA)
Tsuyoshi Ozawa created TEZ-3375: --- Summary: Logging with slf4j way instead of "+" to reduce logging overhead Key: TEZ-3375 URL: https://issues.apache.org/jira/browse/TEZ-3375 Project: Apache Tez

[jira] [Commented] (TEZ-3359) Add granular log levels for HistoryLoggingService.

2016-07-25 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15393231#comment-15393231 ] Hitesh Shah commented on TEZ-3359: -- Comments: {code} } else { 1063 // Validate and set value

[jira] [Assigned] (TEZ-3374) Change TEZ_HISTORY_LOGGING_TIMELINE_NUM_DAGS_PER_GROUP conf key name.

2016-07-25 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa reassigned TEZ-3374: --- Assignee: Tsuyoshi Ozawa > Change TEZ_HISTORY_LOGGING_TIMELINE_NUM_DAGS_PER_GROUP conf key

[jira] [Updated] (TEZ-3374) Change TEZ_HISTORY_LOGGING_TIMELINE_NUM_DAGS_PER_GROUP conf key name.

2016-07-25 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa updated TEZ-3374: Attachment: TEZ-3374.001.patch > Change TEZ_HISTORY_LOGGING_TIMELINE_NUM_DAGS_PER_GROUP conf key

[jira] [Commented] (TEZ-3374) Change TEZ_HISTORY_LOGGING_TIMELINE_NUM_DAGS_PER_GROUP conf key name.

2016-07-25 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15393216#comment-15393216 ] Tsuyoshi Ozawa commented on TEZ-3374: - Attaching first patch. > Change

[jira] [Updated] (TEZ-3359) Add granular log levels for HistoryLoggingService.

2016-07-25 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated TEZ-3359: --- Attachment: TEZ-3359.07.patch Created new patch with --no-prefix > Add granular log levels for

[jira] [Created] (TEZ-3374) Change TEZ_HISTORY_LOGGING_TIMELINE_NUM_DAGS_PER_GROUP conf key name.

2016-07-25 Thread Harish Jaiprakash (JIRA)
Harish Jaiprakash created TEZ-3374: -- Summary: Change TEZ_HISTORY_LOGGING_TIMELINE_NUM_DAGS_PER_GROUP conf key name. Key: TEZ-3374 URL: https://issues.apache.org/jira/browse/TEZ-3374 Project: Apache

[jira] [Updated] (TEZ-3359) Add granular log levels for HistoryLoggingService.

2016-07-25 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated TEZ-3359: --- Attachment: TEZ-3359.06.patch Attaching the correct patch. Fixing bugs and tests pointed out by

Failed: TEZ-3317 PreCommit Build #1878

2016-07-25 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-3317 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/1878/ ### ## LAST 60 LINES OF THE CONSOLE ###

[jira] [Commented] (TEZ-3369) Fixing Tez's DAGClients to work with Cascading

2016-07-25 Thread Chris K Wensel (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392831#comment-15392831 ] Chris K Wensel commented on TEZ-3369: - Cascading simply needs is a way to navigate status/counters from

[jira] [Commented] (TEZ-3338) Support classloader isolation

2016-07-25 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392801#comment-15392801 ] Siddharth Seth commented on TEZ-3338: - bq. No. It doesn't need to be. But we should be able to make a

[jira] [Updated] (TEZ-3360) Tez Custom Shuffle Handler Documentation

2016-07-25 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-3360: - Attachment: TEZ-3360.2.patch > Tez Custom Shuffle Handler Documentation >

[jira] [Commented] (TEZ-3369) Fixing Tez's DAGClients to work with Cascading

2016-07-25 Thread Piyush Narang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392723#comment-15392723 ] Piyush Narang commented on TEZ-3369: [~hitesh] thanks for getting back. Based on what I understand after

[jira] [Comment Edited] (TEZ-3369) Fixing Tez's DAGClients to work with Cascading

2016-07-25 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392645#comment-15392645 ] Hitesh Shah edited comment on TEZ-3369 at 7/25/16 8:52 PM: --- Some general

[jira] [Commented] (TEZ-3369) Fixing Tez's DAGClients to work with Cascading

2016-07-25 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392653#comment-15392653 ] Hitesh Shah commented on TEZ-3369: -- The last time we had a similar discussion around the Cascading

[jira] [Commented] (TEZ-3369) Fixing Tez's DAGClients to work with Cascading

2016-07-25 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392645#comment-15392645 ] Hitesh Shah commented on TEZ-3369: -- Some general background info ( not having looked at the patch yet ):

[jira] [Updated] (TEZ-3360) Tez Custom Shuffle Handler Documentation

2016-07-25 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-3360: - Attachment: TEZ-3360.1.patch > Tez Custom Shuffle Handler Documentation >

[jira] [Assigned] (TEZ-3360) Tez Custom Shuffle Handler Documentation

2016-07-25 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles reassigned TEZ-3360: Assignee: Jonathan Eagles > Tez Custom Shuffle Handler Documentation >

Failed: TEZ-3359 PreCommit Build #1877

2016-07-25 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-3359 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/1877/ ### ## LAST 60 LINES OF THE CONSOLE ###

[jira] [Updated] (TEZ-3359) Add granular log levels for HistoryLoggingService.

2016-07-25 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated TEZ-3359: --- Description: We publish too many events to ATS, this increases the file size for ATS. Reduce

[jira] [Comment Edited] (TEZ-3359) Add granular log levels for HistoryLoggingService.

2016-07-25 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392422#comment-15392422 ] Hitesh Shah edited comment on TEZ-3359 at 7/25/16 6:16 PM: --- Comments: {code} //

[jira] [Commented] (TEZ-3359) Add granular log levels for HistoryLoggingService.

2016-07-25 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392422#comment-15392422 ] Hitesh Shah commented on TEZ-3359: -- Comments: {code} // Copy historyLogLevel from tezConf into dagConf

[jira] [Commented] (TEZ-3371) Tez UI: At times polling is not stopping for completed DAGs

2016-07-25 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392405#comment-15392405 ] Hitesh Shah commented on TEZ-3371: -- [~Sreenath] to be clear, this issue seems only related to the AM

[jira] [Updated] (TEZ-3359) Add granular log levels for HistoryLoggingService.

2016-07-25 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated TEZ-3359: --- Attachment: TEZ-3359.04.patch Addressed new comments and findbugs issue. > Add granular log

[jira] [Comment Edited] (TEZ-3359) Add granular log levels for HistoryLoggingService.

2016-07-25 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392296#comment-15392296 ] Hitesh Shah edited comment on TEZ-3359 at 7/25/16 5:21 PM: --- For some reason, the

[jira] [Commented] (TEZ-3359) Add granular log levels for HistoryLoggingService.

2016-07-25 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392327#comment-15392327 ] Hitesh Shah commented on TEZ-3359: -- Patch mostly looks good. Comments: {code} if

[jira] [Commented] (TEZ-3359) Add granular log levels for HistoryLoggingService.

2016-07-25 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392296#comment-15392296 ] Hitesh Shah commented on TEZ-3359: -- For some reason, the pre-commit did not update jira: >From the

[jira] [Resolved] (TEZ-3316) Speculative execution starts too early due to 0 progress

2016-07-25 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla resolved TEZ-3316. -- Resolution: Duplicate Closing this as a duplicate of TEZ-3317. > Speculative execution starts too early

[jira] [Updated] (TEZ-3317) Speculative execution starts too early due to 0 progress

2016-07-25 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated TEZ-3317: - Attachment: TEZ-3317.001.patch Attaching an initial prototype patch that addresses MRInput and

[jira] [Commented] (TEZ-3371) Tez UI: At times polling is not stopping for completed DAGs

2016-07-25 Thread Sreenath Somarajapuram (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392207#comment-15392207 ] Sreenath Somarajapuram commented on TEZ-3371: - [~jeagles] Both Tez UI V1 & V2 are using

[jira] [Reopened] (TEZ-3317) Speculative execution starts too early due to 0 progress

2016-07-25 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla reopened TEZ-3317: -- Assignee: Kuhu Shukla Re-opening this issue whilst closing TEZ-3316. > Speculative execution starts

[jira] [Updated] (TEZ-3371) Tez UI: At times polling is not stopping for completed DAGs

2016-07-25 Thread Sreenath Somarajapuram (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sreenath Somarajapuram updated TEZ-3371: Target Version/s: 0.9.0, 0.8.5 (was: 0.9.0) > Tez UI: At times polling is not

Success: TEZ-3371 PreCommit Build #1875

2016-07-25 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-3371 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/1875/ ### ## LAST 60 LINES OF THE CONSOLE ###

[jira] [Resolved] (TEZ-3355) Tez Custom Shuffle Handler POC

2016-07-25 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles resolved TEZ-3355. -- Resolution: Fixed Fix Version/s: TEZ-3334 > Tez Custom Shuffle Handler POC >

[jira] [Commented] (TEZ-3371) Tez UI: At times polling is not stopping for completed DAGs

2016-07-25 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392073#comment-15392073 ] Jonathan Eagles commented on TEZ-3371: -- I see similar issues for 0.7.x branch. Is this patch

[jira] [Comment Edited] (TEZ-3371) Tez UI: At times polling is not stopping for completed DAGs

2016-07-25 Thread Sreenath Somarajapuram (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15391954#comment-15391954 ] Sreenath Somarajapuram edited comment on TEZ-3371 at 7/25/16 2:29 PM: --

[jira] [Created] (TEZ-3373) TezClient test case for history logging.

2016-07-25 Thread Harish Jaiprakash (JIRA)
Harish Jaiprakash created TEZ-3373: -- Summary: TezClient test case for history logging. Key: TEZ-3373 URL: https://issues.apache.org/jira/browse/TEZ-3373 Project: Apache Tez Issue Type:

[jira] [Created] (TEZ-3372) Disable logging of counters.

2016-07-25 Thread Harish Jaiprakash (JIRA)
Harish Jaiprakash created TEZ-3372: -- Summary: Disable logging of counters. Key: TEZ-3372 URL: https://issues.apache.org/jira/browse/TEZ-3372 Project: Apache Tez Issue Type: Sub-task

[jira] [Updated] (TEZ-3371) Tez UI: At times polling is not stopping for completed DAGs

2016-07-25 Thread Sreenath Somarajapuram (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sreenath Somarajapuram updated TEZ-3371: Attachment: TEZ-3371.1.patch The patch ensures that - on page load - of a multi-DAG -

[jira] [Created] (TEZ-3371) Tez UI: At times polling is not stopping for completed DAGs

2016-07-25 Thread Sreenath Somarajapuram (JIRA)
Sreenath Somarajapuram created TEZ-3371: --- Summary: Tez UI: At times polling is not stopping for completed DAGs Key: TEZ-3371 URL: https://issues.apache.org/jira/browse/TEZ-3371 Project: Apache

Failed: TEZ-3359 PreCommit Build #1874

2016-07-25 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-3359 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/1874/ ### ## LAST 60 LINES OF THE CONSOLE ###

[jira] [Updated] (TEZ-3359) Add granular log levels for HistoryLoggingService.

2016-07-25 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated TEZ-3359: --- Attachment: TEZ-3359.03.patch * Addressed findbug issue. * Addressed all code review comments.