[jira] [Created] (TEZ-1632) NPE at TestPreemption.testPreemptionWithoutSession line 105

2014-09-30 Thread Alexander Pivovarov (JIRA)
Alexander Pivovarov created TEZ-1632: Summary: NPE at TestPreemption.testPreemptionWithoutSession line 105 Key: TEZ-1632 URL: https://issues.apache.org/jira/browse/TEZ-1632 Project: Apache Tez

[jira] [Updated] (TEZ-1632) NPE at TestPreemption.testPreemptionWithoutSession line 105

2014-09-30 Thread Alexander Pivovarov (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Pivovarov updated TEZ-1632: - Attachment: TEZ-1632.1.patch TEZ-1632.1.patch Sleep 100 ms N times until

[jira] [Reopened] (TEZ-1632) NPE at TestPreemption.testPreemptionWithoutSession line 105

2014-09-30 Thread Alexander Pivovarov (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Pivovarov reopened TEZ-1632: -- NPE at TestPreemption.testPreemptionWithoutSession line 105

[jira] [Comment Edited] (TEZ-1631) Session dag submission timeout can result in duplicate DAG submissions

2014-09-30 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14152996#comment-14152996 ] Jeff Zhang edited comment on TEZ-1631 at 9/30/14 9:16 AM: -- Simulate

[jira] [Commented] (TEZ-1631) Session dag submission timeout can result in duplicate DAG submissions

2014-09-30 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14153011#comment-14153011 ] Jeff Zhang commented on TEZ-1631: - One thing need to be careful is that in the high level

[jira] [Updated] (TEZ-1634) BlockCompressorStream.finish() is called twice in IFile.close leading to Shuffle errors

2014-09-30 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-1634: -- Description: When IFile.Writer is closed, it explicitly calls compressedOut.finish(); And as a

[jira] [Assigned] (TEZ-1634) BlockCompressorStream.finish() is called twice in IFile.close leading to Shuffle errors

2014-09-30 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan reassigned TEZ-1634: - Assignee: Rajesh Balamohan BlockCompressorStream.finish() is called twice in IFile.close

[jira] [Updated] (TEZ-1634) BlockCompressorStream.finish() is called twice in IFile.close leading to Shuffle errors

2014-09-30 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-1634: -- Attachment: (was: BlockCompressorStream.java.with.logging) BlockCompressorStream.finish() is

[jira] [Updated] (TEZ-1634) BlockCompressorStream.finish() is called twice in IFile.close leading to Shuffle errors

2014-09-30 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-1634: -- Attachment: TEZ-1634.1.patch stacktrace-with-comments.txt [~bikassaha] [~gopalv]

[jira] [Updated] (TEZ-1634) BlockCompressorStream.finish() is called twice in IFile.close leading to Shuffle errors

2014-09-30 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-1634: -- Description: When IFile.Writer is closed, it explicitly calls compressedOut.finish(); And as a

[jira] [Updated] (TEZ-1634) BlockCompressorStream.finish() is called twice in IFile.close leading to Shuffle errors

2014-09-30 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-1634: -- Attachment: BlockCompressorStream.with.logging.java BlockCompressorStream.finish() is called

[jira] [Created] (TEZ-1634) BlockCompressorStream.finish() is called twice in IFile.close leading to Shuffle errors

2014-09-30 Thread Rajesh Balamohan (JIRA)
Rajesh Balamohan created TEZ-1634: - Summary: BlockCompressorStream.finish() is called twice in IFile.close leading to Shuffle errors Key: TEZ-1634 URL: https://issues.apache.org/jira/browse/TEZ-1634

[jira] [Commented] (TEZ-1634) BlockCompressorStream.finish() is called twice in IFile.close leading to Shuffle errors

2014-09-30 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14153290#comment-14153290 ] Gopal V commented on TEZ-1634: -- Change looks good, but is hard to read. Can you move the

[jira] [Updated] (TEZ-1631) Session dag submission timeout can result in duplicate DAG submissions

2014-09-30 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1631: Attachment: Tez-1631-2.patch Attach a new patch with unit test. Session dag submission timeout can result

[jira] [Updated] (TEZ-1631) Session dag submission timeout can result in duplicate DAG submissions

2014-09-30 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1631: Attachment: Tez-1631-3.patch Attach a new patch with minor change. Session dag submission timeout can

[jira] [Closed] (TEZ-1483) Ignore unstable tests testReuseNonLocalRequest testReuseLocalResourcesChanged testTaskSchedulerWithReuse

2014-09-30 Thread Alexander Pivovarov (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Pivovarov closed TEZ-1483. Ignore unstable tests testReuseNonLocalRequest testReuseLocalResourcesChanged

[jira] [Closed] (TEZ-1484) testTaskSchedulerWithReuse is unstable

2014-09-30 Thread Alexander Pivovarov (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Pivovarov closed TEZ-1484. testTaskSchedulerWithReuse is unstable --

[jira] [Closed] (TEZ-1378) Comment of TestTaskImpl assertTaskKillWaitState is deprecated

2014-09-30 Thread Alexander Pivovarov (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Pivovarov closed TEZ-1378. Comment of TestTaskImpl assertTaskKillWaitState is deprecated

[jira] [Comment Edited] (TEZ-1462) Remove unnecessary SuppressWarnings

2014-09-30 Thread Alexander Pivovarov (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14102711#comment-14102711 ] Alexander Pivovarov edited comment on TEZ-1462 at 9/30/14 6:26 PM:

[jira] [Comment Edited] (TEZ-1462) Remove unnecessary SuppressWarnings

2014-09-30 Thread Alexander Pivovarov (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14153517#comment-14153517 ] Alexander Pivovarov edited comment on TEZ-1462 at 9/30/14 6:27 PM:

[jira] [Commented] (TEZ-1621) Should report error to AM before shuting down TezChild

2014-09-30 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14153561#comment-14153561 ] Bikas Saha commented on TEZ-1621: - bq. One concern I have is that there's duplicated code

[jira] [Commented] (TEZ-1620) Wait for application finish before stopping MiniTezCluster

2014-09-30 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14153570#comment-14153570 ] Bikas Saha commented on TEZ-1620: - I added a yarnClient.stop() in waitForAppsToFinish() and

[jira] [Commented] (TEZ-1592) Vertex should wait for all initializers to finish before moving to INITED state

2014-09-30 Thread Vikram Dixit K (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14153638#comment-14153638 ] Vikram Dixit K commented on TEZ-1592: - [~bikassaha] I am seeing tasks getting stuck with

[jira] [Reopened] (TEZ-1592) Vertex should wait for all initializers to finish before moving to INITED state

2014-09-30 Thread Vikram Dixit K (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikram Dixit K reopened TEZ-1592: - I am seeing tasks getting stuck in 0.5.1. Vertex should wait for all initializers to finish before

[jira] [Issue Comment Deleted] (TEZ-1592) Vertex should wait for all initializers to finish before moving to INITED state

2014-09-30 Thread Vikram Dixit K (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikram Dixit K updated TEZ-1592: Comment: was deleted (was: I am seeing tasks getting stuck in 0.5.1.) Vertex should wait for all

[jira] [Updated] (TEZ-1634) BlockCompressorStream.finish() is called twice in IFile.close leading to Shuffle errors

2014-09-30 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated TEZ-1634: - Attachment: TEZ-1634.2.patch Small cosmetic change, for easier debugging. Please review - [~rajesh.balamohan].

[jira] [Commented] (TEZ-1592) Vertex should wait for all initializers to finish before moving to INITED state

2014-09-30 Thread Vikram Dixit K (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14153691#comment-14153691 ] Vikram Dixit K commented on TEZ-1592: - This seems intermittent as well. I see have seen

[jira] [Created] (TEZ-1635) Dag gets stuck intermittently

2014-09-30 Thread Vikram Dixit K (JIRA)
Vikram Dixit K created TEZ-1635: --- Summary: Dag gets stuck intermittently Key: TEZ-1635 URL: https://issues.apache.org/jira/browse/TEZ-1635 Project: Apache Tez Issue Type: Bug Affects

[jira] [Updated] (TEZ-1635) Dag gets stuck intermittently

2014-09-30 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-1635: Affects Version/s: (was: 0.5.1) 0.5.0 Dag gets stuck intermittently

[jira] [Commented] (TEZ-1635) Dag gets stuck intermittently

2014-09-30 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14153796#comment-14153796 ] Bikas Saha commented on TEZ-1635: - Also there are no logs for the stuck tasks. Dag gets

[jira] [Commented] (TEZ-1634) BlockCompressorStream.finish() is called twice in IFile.close leading to Shuffle errors

2014-09-30 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14153872#comment-14153872 ] Rajesh Balamohan commented on TEZ-1634: --- lgtm. +1. BlockCompressorStream.finish() is

[jira] [Commented] (TEZ-1631) Session dag submission timeout can result in duplicate DAG submissions

2014-09-30 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14154058#comment-14154058 ] Jeff Zhang commented on TEZ-1631: - bq. This patch looks similar to TEZ-1433-v1.patch on

[jira] [Created] (TEZ-1636) Duplicated code for checking exception types in TezTaskRunner and TaskRunnerCallable,

2014-09-30 Thread Jeff Zhang (JIRA)
Jeff Zhang created TEZ-1636: --- Summary: Duplicated code for checking exception types in TezTaskRunner and TaskRunnerCallable, Key: TEZ-1636 URL: https://issues.apache.org/jira/browse/TEZ-1636 Project:

[jira] [Updated] (TEZ-1631) Session dag submission timeout can result in duplicate DAG submissions

2014-09-30 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-1631: Attachment: TEZ-1631.5.patch Attaching patch with minor changes. Session dag submission timeout can result

[jira] [Updated] (TEZ-1634) BlockCompressorStream.finish() is called twice in IFile.close leading to Shuffle errors

2014-09-30 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated TEZ-1634: - Fix Version/s: 0.6.0 BlockCompressorStream.finish() is called twice in IFile.close leading to Shuffle errors