[jira] [Commented] (TEZ-2016) Tez UI: Dag View Fit and Finish

2015-04-13 Thread Sreenath Somarajapuram (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14492750#comment-14492750 ] Sreenath Somarajapuram commented on TEZ-2016: - Check in checkbox is not

[jira] [Commented] (TEZ-2303) ConcurrentModificationException while processing recovery

2015-04-13 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14492784#comment-14492784 ] Hitesh Shah commented on TEZ-2303: -- [~zjffdu] A couple of things - not sure if the write

[jira] [Commented] (TEZ-1482) Fix memory issues for Local Mode running concurrent tasks

2015-04-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14492749#comment-14492749 ] Siddharth Seth commented on TEZ-1482: - [~pramachandran] - it should be sufficient to

[jira] [Commented] (TEZ-2309) Fix slf4j dependencies for tez modules

2015-04-13 Thread Vasanth kumar RJ (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493138#comment-14493138 ] Vasanth kumar RJ commented on TEZ-2309: --- [~hitesh], slf4j-log4j12 module has slf4j-api

[jira] [Commented] (TEZ-2309) Fix slf4j dependencies for tez modules

2015-04-13 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493141#comment-14493141 ] Hitesh Shah commented on TEZ-2309: -- Understood but given that we are using apis from

[jira] [Commented] (TEZ-2309) Fix slf4j dependencies for tez modules

2015-04-13 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493097#comment-14493097 ] Hitesh Shah commented on TEZ-2309: -- Thanks for the clarification [~vasanthkumar]. Given

[jira] [Updated] (TEZ-2313) Regression in handling obsolete events in ShuffleScheduler

2015-04-13 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-2313: Priority: Blocker (was: Critical) Regression in handling obsolete events in ShuffleScheduler

[jira] [Created] (TEZ-2313) Regression in handling obsolete events in ShuffleScheduler

2015-04-13 Thread Bikas Saha (JIRA)
Bikas Saha created TEZ-2313: --- Summary: Regression in handling obsolete events in ShuffleScheduler Key: TEZ-2313 URL: https://issues.apache.org/jira/browse/TEZ-2313 Project: Apache Tez Issue Type:

[jira] [Commented] (TEZ-2309) Fix slf4j dependencies for tez modules

2015-04-13 Thread Vasanth kumar RJ (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493196#comment-14493196 ] Vasanth kumar RJ commented on TEZ-2309: --- Yes. Using slf4j-log4j12 take its dependent

[jira] [Commented] (TEZ-2315) TEZ does not call checkOutputSpecs on OutputFormat

2015-04-13 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493395#comment-14493395 ] Sergey Shelukhin commented on TEZ-2315: --- Tez uses OutputFormat though. OutputCommitter

[jira] [Updated] (TEZ-2313) Regression in handling obsolete events in ShuffleScheduler

2015-04-13 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-2313: -- Attachment: TEZ-2313.WIP.patch ShuffleEventInfo was getting added to eventsMap even when

[jira] [Comment Edited] (TEZ-2033) Update TestOrderedWordCount to add processor configs as history text

2015-04-13 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493214#comment-14493214 ] Hitesh Shah edited comment on TEZ-2033 at 4/13/15 10:47 PM:

[jira] [Updated] (TEZ-2033) Update TestOrderedWordCount to add processor configs as history text

2015-04-13 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-2033: - Attachment: TEZ-2033.1.patch [~sseth] review please. Update TestOrderedWordCount to add processor

[jira] [Created] (TEZ-2314) Tez task attempt failures due to bad event serialization

2015-04-13 Thread Rohini Palaniswamy (JIRA)
Rohini Palaniswamy created TEZ-2314: --- Summary: Tez task attempt failures due to bad event serialization Key: TEZ-2314 URL: https://issues.apache.org/jira/browse/TEZ-2314 Project: Apache Tez

[jira] [Commented] (TEZ-776) Reduce AM mem usage caused by storing TezEvents

2015-04-13 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493244#comment-14493244 ] Rohini Palaniswamy commented on TEZ-776: bq. 95 million events in memory is crazy.

[jira] [Updated] (TEZ-2315) TEZ does not call checkOutputSpecs on OutputFormat

2015-04-13 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated TEZ-2315: -- Assignee: Siddharth Seth TEZ does not call checkOutputSpecs on OutputFormat

[jira] [Updated] (TEZ-2315) TEZ does not call checkOutputSpecs on OutputFormat

2015-04-13 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated TEZ-2315: -- Description: In JobSubmitter::submitJobInternal, MR does: {noformat} private void

[jira] [Commented] (TEZ-2033) Update TestOrderedWordCount to add processor configs as history text and use MR configs correctly

2015-04-13 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493277#comment-14493277 ] TezQA commented on TEZ-2033: {color:green}+1 overall{color}. Here are the results of testing

Success: TEZ-2033 PreCommit Build #456

2015-04-13 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-2033 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/456/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated

[jira] [Comment Edited] (TEZ-2315) TEZ does not call checkOutputSpecs on OutputFormat

2015-04-13 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493385#comment-14493385 ] Hitesh Shah edited comment on TEZ-2315 at 4/14/15 12:58 AM: That

[jira] [Commented] (TEZ-2315) TEZ does not call checkOutputSpecs on OutputFormat

2015-04-13 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493397#comment-14493397 ] Hitesh Shah commented on TEZ-2315: -- Sorry - got wires crossed. Something might be possible

[jira] [Updated] (TEZ-2033) Update TestOrderedWordCount to add processor configs as history text and use MR configs correctly

2015-04-13 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-2033: - Summary: Update TestOrderedWordCount to add processor configs as history text and use MR configs correctly

[jira] [Created] (TEZ-2315) TEZ does not call checkOutputSpecs on OutputFormat

2015-04-13 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created TEZ-2315: - Summary: TEZ does not call checkOutputSpecs on OutputFormat Key: TEZ-2315 URL: https://issues.apache.org/jira/browse/TEZ-2315 Project: Apache Tez Issue

[jira] [Commented] (TEZ-2315) TEZ does not call checkOutputSpecs on OutputFormat

2015-04-13 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493385#comment-14493385 ] Hitesh Shah commented on TEZ-2315: -- That is unlikely to work. The user payload provided to

[jira] [Commented] (TEZ-1752) Inputs / Outputs in the Runtime library should be interruptable

2015-04-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493493#comment-14493493 ] Siddharth Seth commented on TEZ-1752: - [~rajesh.balamohan] - thanks for taking this up.

[jira] [Assigned] (TEZ-2310) AM Deadlock in VertexImpl

2015-04-13 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha reassigned TEZ-2310: --- Assignee: Bikas Saha AM Deadlock in VertexImpl - Key:

[jira] [Commented] (TEZ-2310) AM Deadlock in VertexImpl

2015-04-13 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14492683#comment-14492683 ] Bikas Saha commented on TEZ-2310: - Looking at this. AM Deadlock in VertexImpl

[jira] [Updated] (TEZ-2016) Tez UI: Dag View Fit and Finish

2015-04-13 Thread Prakash Ramachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prakash Ramachandran updated TEZ-2016: -- Summary: Tez UI: Dag View Fit and Finish (was: Tez UI Dag View Fit and Finish) Tez UI:

[jira] [Commented] (TEZ-1482) Fix memory issues for Local Mode running concurrent tasks

2015-04-13 Thread Prakash Ramachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14492697#comment-14492697 ] Prakash Ramachandran commented on TEZ-1482: --- [~sseth] fixed the findbugs. can you

[jira] [Updated] (TEZ-2275) Tez UI: enable faster loading and caching of data in tables

2015-04-13 Thread Prakash Ramachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prakash Ramachandran updated TEZ-2275: -- Summary: Tez UI: enable faster loading and caching of data in tables (was: TEZ UI: Make

[jira] [Commented] (TEZ-2275) Tez UI: enable faster loading and caching of data in tables

2015-04-13 Thread Prakash Ramachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14492083#comment-14492083 ] Prakash Ramachandran commented on TEZ-2275: --- +1 LTGM. Tez UI: enable faster

[jira] [Commented] (TEZ-2303) ConcurrentModificationException while processing recovery

2015-04-13 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14492046#comment-14492046 ] Jeff Zhang commented on TEZ-2303: - DAG/Vertex/Task may has the similar issue.

[jira] [Assigned] (TEZ-2303) ConcurrentModificationException while processing recovery

2015-04-13 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang reassigned TEZ-2303: --- Assignee: Jeff Zhang ConcurrentModificationException while processing recovery

[jira] [Comment Edited] (TEZ-2303) ConcurrentModificationException while processing recovery

2015-04-13 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14492046#comment-14492046 ] Jeff Zhang edited comment on TEZ-2303 at 4/13/15 7:59 AM: --

[jira] [Updated] (TEZ-2275) Tez UI: enable faster loading and caching of data in tables

2015-04-13 Thread Prakash Ramachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prakash Ramachandran updated TEZ-2275: -- Component/s: UI Fix Version/s: 0.7.0 Tez UI: enable faster loading and caching of

[jira] [Updated] (TEZ-714) OutputCommitters should not run in the main AM dispatcher thread

2015-04-13 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-714: --- Attachment: TEZ-714-17.patch Upload patch again to retrigger the build OutputCommitters should not run in the

[jira] [Comment Edited] (TEZ-2303) ConcurrentModificationException while processing recovery

2015-04-13 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14492046#comment-14492046 ] Jeff Zhang edited comment on TEZ-2303 at 4/13/15 7:49 AM: --

Success: TEZ-714 PreCommit Build #453

2015-04-13 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-714 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/453/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated

[jira] [Commented] (TEZ-714) OutputCommitters should not run in the main AM dispatcher thread

2015-04-13 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14492069#comment-14492069 ] TezQA commented on TEZ-714: --- {color:green}+1 overall{color}. Here are the results of testing the

[jira] [Updated] (TEZ-2252) Tez UI Graphical view looks wrong in some cases

2015-04-13 Thread Sreenath Somarajapuram (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sreenath Somarajapuram updated TEZ-2252: Attachment: TEZ-2252.2.patch UT failure looks unrelated: Attaching a copy of patch 1

[jira] [Commented] (TEZ-2016) Tez UI Dag View Fit and Finish

2015-04-13 Thread Prakash Ramachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14492216#comment-14492216 ] Prakash Ramachandran commented on TEZ-2016: --- * please remove the changes in

[jira] [Updated] (TEZ-2016) Tez UI Dag View Fit and Finish

2015-04-13 Thread Sreenath Somarajapuram (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sreenath Somarajapuram updated TEZ-2016: Attachment: TEZ-2016.2.patch Thanks [~pramachandran]. - Sorry for the configs.js that

Failed: TEZ-2252 PreCommit Build #454

2015-04-13 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-2252 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/454/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated

[jira] [Commented] (TEZ-2252) Tez UI Graphical view looks wrong in some cases

2015-04-13 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14492287#comment-14492287 ] TezQA commented on TEZ-2252: {color:red}-1 overall{color}. Here are the results of testing the

[jira] [Commented] (TEZ-2252) Tez UI: in graphical view some of the sinks are hidden as they overlap

2015-04-13 Thread Prakash Ramachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14492291#comment-14492291 ] Prakash Ramachandran commented on TEZ-2252: --- +1 LGTM committing. Tez UI: in

Failed: TEZ-2016 PreCommit Build #455

2015-04-13 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-2016 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/455/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated

[jira] [Commented] (TEZ-2016) Tez UI Dag View Fit and Finish

2015-04-13 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14492320#comment-14492320 ] TezQA commented on TEZ-2016: {color:red}-1 overall{color}. Here are the results of testing the

[jira] [Updated] (TEZ-2304) InvalidStateTransitonException TA_SCHEDULE at START_WAIT during recovery

2015-04-13 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated TEZ-2304: Attachment: 168563_recovery.gz Posting the logs of the second AM attempt up to the point of the first invalid

[jira] [Created] (TEZ-2311) AM can hang if kill received while recovering from previous attempt

2015-04-13 Thread Jason Lowe (JIRA)
Jason Lowe created TEZ-2311: --- Summary: AM can hang if kill received while recovering from previous attempt Key: TEZ-2311 URL: https://issues.apache.org/jira/browse/TEZ-2311 Project: Apache Tez

[jira] [Commented] (TEZ-2311) AM can hang if kill received while recovering from previous attempt

2015-04-13 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14492617#comment-14492617 ] Jason Lowe commented on TEZ-2311: - The AM appeared to hang because it was still waiting for

[jira] [Commented] (TEZ-2016) Tez UI Dag View Fit and Finish

2015-04-13 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14492505#comment-14492505 ] Jonathan Eagles commented on TEZ-2016: -- That is correct. If i hit the spacebar it will