[jira] [Created] (TEZ-1326) AMStartedEvent should not be recovery event

Jeff Zhang created TEZ-1326: --- Summary: AMStartedEvent should not be recovery event Key: TEZ-1326 URL: https://issues.apache.org/jira/browse/TEZ-1326 Project: Apache Tez Issue Type: Bug Affects

[jira] [Updated] (TEZ-1342) tez.am.client.am.port-range not taking effect

[ https://issues.apache.org/jira/browse/TEZ-1342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1342: Attachment: Tez-1342.patch Attach the patch. We should pass the port-range property name instead of the

[jira] [Commented] (TEZ-1065) DAGStatus.getVertexStatus and other vertex related API's should maintain vertex order

[ https://issues.apache.org/jira/browse/TEZ-1065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079645#comment-14079645 ] Jeff Zhang commented on TEZ-1065: - Will work on this. DAGStatus.getVertexStatus and other

[jira] [Updated] (TEZ-1342) tez.am.client.am.port-range not taking effect

[ https://issues.apache.org/jira/browse/TEZ-1342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1342: Attachment: Tez-1342-2.patch tez.am.client.am.port-range not taking effect

[jira] [Commented] (TEZ-1342) tez.am.client.am.port-range not taking effect

[ https://issues.apache.org/jira/browse/TEZ-1342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079977#comment-14079977 ] Jeff Zhang commented on TEZ-1342: - [~seth.siddha...@gmail.com] I update the patch with

[jira] [Updated] (TEZ-1238) Display more clear diagnostics info on client side if missing jar in LocalResource or Exception happen in Processor

[ https://issues.apache.org/jira/browse/TEZ-1238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1238: Attachment: Tez-1238-2.patch Upload the correct patch :) Display more clear diagnostics info on client

[jira] [Updated] (TEZ-1238) Display more clear diagnostics info on client side if missing jar in LocalResource or Exception happen in Processor

[ https://issues.apache.org/jira/browse/TEZ-1238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1238: Attachment: (was: Tez-1273-2.patch) Display more clear diagnostics info on client side if missing jar

[jira] [Updated] (TEZ-1064) Restore dagName Set for duplicate detection in recovered AMs.

[ https://issues.apache.org/jira/browse/TEZ-1064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1064: Attachment: (was: Tez-1064-3.patch) Restore dagName Set for duplicate detection in recovered AMs.

[jira] [Updated] (TEZ-1064) Restore dagName Set for duplicate detection in recovered AMs.

[ https://issues.apache.org/jira/browse/TEZ-1064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1064: Attachment: Tez-1064-3.patch Restore dagName Set for duplicate detection in recovered AMs.

[jira] [Commented] (TEZ-1064) Restore dagName Set for duplicate detection in recovered AMs.

[ https://issues.apache.org/jira/browse/TEZ-1064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080298#comment-14080298 ] Jeff Zhang commented on TEZ-1064: - [~hitesh] I update the patch, please help review it.

[jira] [Updated] (TEZ-1064) Restore dagName Set for duplicate detection in recovered AMs.

[ https://issues.apache.org/jira/browse/TEZ-1064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1064: Attachment: (was: Tez-1064-3.patch) Restore dagName Set for duplicate detection in recovered AMs.

[jira] [Updated] (TEZ-1064) Restore dagName Set for duplicate detection in recovered AMs.

[ https://issues.apache.org/jira/browse/TEZ-1064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1064: Attachment: Tez-1064-3.patch Delete the previou patch,upload new patch ( update test case ) Restore

[jira] [Updated] (TEZ-1064) Restore dagName Set for duplicate detection in recovered AMs.

[ https://issues.apache.org/jira/browse/TEZ-1064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1064: Attachment: Tez-1064-4.patch Restore dagName Set for duplicate detection in recovered AMs.

[jira] [Commented] (TEZ-1064) Restore dagName Set for duplicate detection in recovered AMs.

[ https://issues.apache.org/jira/browse/TEZ-1064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080348#comment-14080348 ] Jeff Zhang commented on TEZ-1064: - Update the patch. ( remove the change of

[jira] [Commented] (TEZ-1342) tez.am.client.am.port-range not taking effect

[ https://issues.apache.org/jira/browse/TEZ-1342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080511#comment-14080511 ] Jeff Zhang commented on TEZ-1342: - [~seth.siddha...@gmail.com] bq. It's possible that the

[jira] [Commented] (TEZ-1238) Display more clear diagnostics info on client side if missing jar in LocalResource or Exception happen in Processor

[ https://issues.apache.org/jira/browse/TEZ-1238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081142#comment-14081142 ] Jeff Zhang commented on TEZ-1238: - [~hitesh] I have rebased the patch since [TEZ-1303 |

[jira] [Updated] (TEZ-1065) DAGStatus.getVertexStatus and other vertex related API's should maintain vertex order

[ https://issues.apache.org/jira/browse/TEZ-1065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1065: Attachment: Tez-1065.patch DAGStatus.getVertexStatus and other vertex related API's should maintain

[jira] [Commented] (TEZ-1065) DAGStatus.getVertexStatus and other vertex related API's should maintain vertex order

[ https://issues.apache.org/jira/browse/TEZ-1065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14082534#comment-14082534 ] Jeff Zhang commented on TEZ-1065: - Attach the patch. DAGStatus.getVertexStatus and other

[jira] [Updated] (TEZ-1065) DAGStatus.getVertexStatus and other vertex related API's should maintain vertex order

[ https://issues.apache.org/jira/browse/TEZ-1065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1065: Attachment: Tez-1065-2.patch Update the patch. ( Missing apache header in the previous patch )

[jira] [Commented] (TEZ-1065) DAGStatus.getVertexStatus and other vertex related API's should maintain vertex order

[ https://issues.apache.org/jira/browse/TEZ-1065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14082543#comment-14082543 ] Jeff Zhang commented on TEZ-1065: - Attach the patch. [~bikassaha] Please help review it.

[jira] [Created] (TEZ-1375) Restore successfulAttempt from TaskFinishedEvent instead of TaskAttemptFinishedEvent

Jeff Zhang created TEZ-1375: --- Summary: Restore successfulAttempt from TaskFinishedEvent instead of TaskAttemptFinishedEvent Key: TEZ-1375 URL: https://issues.apache.org/jira/browse/TEZ-1375 Project: Apache

[jira] [Updated] (TEZ-1375) Restore successfulAttempt from TaskFinishedEvent instead of TaskAttemptFinishedEvent

[ https://issues.apache.org/jira/browse/TEZ-1375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1375: Description: Currently the field Restore successfulAttempt from TaskFinishedEvent instead of

[jira] [Updated] (TEZ-1024) Fix determination of failed attempts

[ https://issues.apache.org/jira/browse/TEZ-1024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1024: Attachment: Tez-1024-2.patch Fix determination of failed attempts

[jira] [Created] (TEZ-1383) Move recovery related code into inner class

Jeff Zhang created TEZ-1383: --- Summary: Move recovery related code into inner class Key: TEZ-1383 URL: https://issues.apache.org/jira/browse/TEZ-1383 Project: Apache Tez Issue Type: Improvement

[jira] [Updated] (TEZ-1384) Move recovery related code into inner class

[ https://issues.apache.org/jira/browse/TEZ-1384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1384: Description: Currently each entity (DAG, Vertex, Task, TaskAttempt) has some common recovery code like log

[jira] [Updated] (TEZ-1384) Move recovery related code into inner class

[ https://issues.apache.org/jira/browse/TEZ-1384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1384: Attachment: Tez-1384.patch Move recovery related code into inner class

[jira] [Assigned] (TEZ-850) Recovery unit tests

[ https://issues.apache.org/jira/browse/TEZ-850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang reassigned TEZ-850: -- Assignee: Jeff Zhang (was: Hitesh Shah) Recovery unit tests --- Key:

[jira] [Commented] (TEZ-1383) Move recovery related code into inner class

[ https://issues.apache.org/jira/browse/TEZ-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14089993#comment-14089993 ] Jeff Zhang commented on TEZ-1383: - [~hitesh], looks like I create the same issue 2 times.

[jira] [Commented] (TEZ-1210) TezClientUtils.localizeDagPlanAsText() needs to be fixed for session mode

[ https://issues.apache.org/jira/browse/TEZ-1210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14090013#comment-14090013 ] Jeff Zhang commented on TEZ-1210: - [~gavinmead] I am working on other jiras, may not have

[jira] [Commented] (TEZ-850) Recovery unit tests

[ https://issues.apache.org/jira/browse/TEZ-850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14090416#comment-14090416 ] Jeff Zhang commented on TEZ-850: [~hitesh], I have done some work on this. But considering

[jira] [Commented] (TEZ-1358) Display better diagnostics when tasks fail to launch

[ https://issues.apache.org/jira/browse/TEZ-1358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14092456#comment-14092456 ] Jeff Zhang commented on TEZ-1358: - [~hitesh] these error are returned by YARN when container

[jira] [Created] (TEZ-1404) recoveredGroupCommits of DAGImpl is not set correctly

Jeff Zhang created TEZ-1404: --- Summary: recoveredGroupCommits of DAGImpl is not set correctly Key: TEZ-1404 URL: https://issues.apache.org/jira/browse/TEZ-1404 Project: Apache Tez Issue Type: Bug

[jira] [Updated] (TEZ-1404) groupCommitInProgress in RecoveryTransition of DAGImpl is not set correctly

[ https://issues.apache.org/jira/browse/TEZ-1404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1404: Summary: groupCommitInProgress in RecoveryTransition of DAGImpl is not set correctly (was:

[jira] [Commented] (TEZ-1404) groupCommitInProgress in RecoveryTransition of DAGImpl is not set correctly

[ https://issues.apache.org/jira/browse/TEZ-1404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14092613#comment-14092613 ] Jeff Zhang commented on TEZ-1404: - Attach the trivial patch. No Unit Test included, plan to

[jira] [Updated] (TEZ-1404) groupCommitInProgress in RecoveryTransition of DAGImpl is not set correctly

[ https://issues.apache.org/jira/browse/TEZ-1404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1404: Attachment: Tez-1404.patch groupCommitInProgress in RecoveryTransition of DAGImpl is not set correctly

[jira] [Assigned] (TEZ-1345) Add checks to guarantee all init events are written to recovery to consider vertex initialized

[ https://issues.apache.org/jira/browse/TEZ-1345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang reassigned TEZ-1345: --- Assignee: Jeff Zhang (was: Hitesh Shah) Add checks to guarantee all init events are written to

[jira] [Commented] (TEZ-1132) Consistent naming of Input and Outputs

[ https://issues.apache.org/jira/browse/TEZ-1132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096298#comment-14096298 ] Jeff Zhang commented on TEZ-1132: - [~bikassaha] Sure, please take this. Consistent naming

[jira] [Comment Edited] (TEZ-1132) Consistent naming of Input and Outputs

[ https://issues.apache.org/jira/browse/TEZ-1132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096298#comment-14096298 ] Jeff Zhang edited comment on TEZ-1132 at 8/13/14 11:29 PM: ---

[jira] [Commented] (TEZ-1345) Add checks to guarantee all init events are written to recovery to consider vertex initialized

[ https://issues.apache.org/jira/browse/TEZ-1345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096356#comment-14096356 ] Jeff Zhang commented on TEZ-1345: - Attach the patch. [~hitesh] I make the following

[jira] [Updated] (TEZ-1065) DAGStatus.getVertexStatus and other vertex related API's should maintain vertex order

[ https://issues.apache.org/jira/browse/TEZ-1065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1065: Attachment: Tez-1065-3.patch DAGStatus.getVertexStatus and other vertex related API's should maintain

[jira] [Commented] (TEZ-1065) DAGStatus.getVertexStatus and other vertex related API's should maintain vertex order

[ https://issues.apache.org/jira/browse/TEZ-1065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096904#comment-14096904 ] Jeff Zhang commented on TEZ-1065: - [~bikassaha] I attach the patch. Changes in patch, *

[jira] [Commented] (TEZ-1065) DAGStatus.getVertexStatus and other vertex related API's should maintain vertex order

[ https://issues.apache.org/jira/browse/TEZ-1065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14098366#comment-14098366 ] Jeff Zhang commented on TEZ-1065: - [~bikassaha] I update the patch, please help review.

[jira] [Commented] (TEZ-1065) DAGStatus.getVertexStatus and other vertex related API's should maintain vertex order

[ https://issues.apache.org/jira/browse/TEZ-1065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14099372#comment-14099372 ] Jeff Zhang commented on TEZ-1065: - [~bikassaha] Thanks for fixing the test failure, will run

[jira] [Comment Edited] (TEZ-850) Recovery unit tests

[ https://issues.apache.org/jira/browse/TEZ-850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14100295#comment-14100295 ] Jeff Zhang edited comment on TEZ-850 at 8/18/14 5:35 AM: - [~hitesh]

[jira] [Updated] (TEZ-1325) Change dagSummaryDataMap in RecoverParser to LinkedHashMap to help find the lastCompletedDAG

[ https://issues.apache.org/jira/browse/TEZ-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1325: Attachment: Tez-1325.patch Change dagSummaryDataMap in RecoverParser to LinkedHashMap to help find the

[jira] [Commented] (TEZ-1325) Change dagSummaryDataMap in RecoverParser to LinkedHashMap to help find the lastCompletedDAG

[ https://issues.apache.org/jira/browse/TEZ-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14101833#comment-14101833 ] Jeff Zhang commented on TEZ-1325: - Attach the patch. * change dagSummaryDataMap to

[jira] [Updated] (TEZ-850) Recovery unit tests

[ https://issues.apache.org/jira/browse/TEZ-850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-850: --- Attachment: Tez-850.patch Recovery unit tests --- Key: TEZ-850

[jira] [Commented] (TEZ-850) Recovery unit tests

[ https://issues.apache.org/jira/browse/TEZ-850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14102070#comment-14102070 ] Jeff Zhang commented on TEZ-850: [~hitesh] Attach the patch. * Recovery Unit test for DAG,

[jira] [Updated] (TEZ-1325) RecoveryParser can find incorrect last DAG ID

[ https://issues.apache.org/jira/browse/TEZ-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1325: Attachment: Tez-1325-3.patch RecoveryParser can find incorrect last DAG ID

[jira] [Commented] (TEZ-1325) RecoveryParser can find incorrect last DAG ID

[ https://issues.apache.org/jira/browse/TEZ-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14103132#comment-14103132 ] Jeff Zhang commented on TEZ-1325: - [~hitesh] Attach the updated patch based your comments.

[jira] [Updated] (TEZ-1470) TaskFinishedEvent is recorded multiple times

[ https://issues.apache.org/jira/browse/TEZ-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1470: Description: When AM is in attempt 2, sometimes TaskFinishedEvent may be recorded multiple times, although

[jira] [Updated] (TEZ-1470) TaskFinishedEvent is recorded multiple times

[ https://issues.apache.org/jira/browse/TEZ-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1470: Issue Type: Sub-task (was: Bug) Parent: TEZ-15 TaskFinishedEvent is recorded multiple times

[jira] [Assigned] (TEZ-853) Support counters recovery

[ https://issues.apache.org/jira/browse/TEZ-853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang reassigned TEZ-853: -- Assignee: Jeff Zhang Support counters recovery - Key: TEZ-853

[jira] [Commented] (TEZ-853) Support counters recovery

[ https://issues.apache.org/jira/browse/TEZ-853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14103895#comment-14103895 ] Jeff Zhang commented on TEZ-853: start working on this. Support counters recovery

[jira] [Commented] (TEZ-1476) DAGClient waitForCompletion output is confusing

[ https://issues.apache.org/jira/browse/TEZ-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106121#comment-14106121 ] Jeff Zhang commented on TEZ-1476: - Meet the same issue. And I remember the behavior is

[jira] [Assigned] (TEZ-1481) Flaky test : org.apache.tez.dag.api.client.TestDAGClientHandler.testDAGClientHandler

[ https://issues.apache.org/jira/browse/TEZ-1481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang reassigned TEZ-1481: --- Assignee: Jeff Zhang Flaky test :

[jira] [Commented] (TEZ-1481) Flaky test : org.apache.tez.dag.api.client.TestDAGClientHandler.testDAGClientHandler

[ https://issues.apache.org/jira/browse/TEZ-1481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107920#comment-14107920 ] Jeff Zhang commented on TEZ-1481: - [~apivovarov] Thanks for the quick patch, assign it to

[jira] [Updated] (TEZ-853) Support counters recovery

[ https://issues.apache.org/jira/browse/TEZ-853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-853: --- Attachment: Tez-853.patch Support counters recovery - Key: TEZ-853

[jira] [Commented] (TEZ-853) Support counters recovery

[ https://issues.apache.org/jira/browse/TEZ-853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14108693#comment-14108693 ] Jeff Zhang commented on TEZ-853: [~hitesh] Attach the patch. * Fix one small bug in

[jira] [Updated] (TEZ-1493) WordCount example fails in recovery

[ https://issues.apache.org/jira/browse/TEZ-1493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1493: Description: {code} 14/08/25 17:37:03 INFO client.TezClient: Submitting DAG to YARN,

[jira] [Updated] (TEZ-1493) WordCount example fails in recovery

[ https://issues.apache.org/jira/browse/TEZ-1493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1493: Attachment: Tez-1493.patch WordCount example fails in recovery ---

[jira] [Commented] (TEZ-1493) WordCount example fails in recovery

[ https://issues.apache.org/jira/browse/TEZ-1493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14109015#comment-14109015 ] Jeff Zhang commented on TEZ-1493: - Attach the patch. The reason of this issue is that when

[jira] [Updated] (TEZ-1493) Tez examples fail in recovery sometimes

[ https://issues.apache.org/jira/browse/TEZ-1493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1493: Summary: Tez examples fail in recovery sometimes (was: WordCount example fails in recovery) Tez examples

[jira] [Created] (TEZ-1498) Usage info is not printed when error number of arguments for JoinExample

Jeff Zhang created TEZ-1498: --- Summary: Usage info is not printed when error number of arguments for JoinExample Key: TEZ-1498 URL: https://issues.apache.org/jira/browse/TEZ-1498 Project: Apache Tez

[jira] [Updated] (TEZ-1499) Add OrderedJoinExample to tez-examples

[ https://issues.apache.org/jira/browse/TEZ-1499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1499: Description: In the current join example, the inputs of JoinProcessor is unordered so that it will always

[jira] [Commented] (TEZ-1501) Add a test dag to generate load on the getTask RPC

[ https://issues.apache.org/jira/browse/TEZ-1501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14110598#comment-14110598 ] Jeff Zhang commented on TEZ-1501: - [~sseth] The TexExampleBase is very helpful, and I notice

[jira] [Commented] (TEZ-853) Support counters recovery

[ https://issues.apache.org/jira/browse/TEZ-853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14111540#comment-14111540 ] Jeff Zhang commented on TEZ-853: [~hitesh] The task attempt counters is recovered from

[jira] [Commented] (TEZ-1493) Tez examples fail in recovery sometimes

[ https://issues.apache.org/jira/browse/TEZ-1493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14111558#comment-14111558 ] Jeff Zhang commented on TEZ-1493: - [~hitesh] Please try the new patch (Tez-1493-2.patch)

[jira] [Updated] (TEZ-1493) Tez examples fail in recovery sometimes

[ https://issues.apache.org/jira/browse/TEZ-1493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1493: Attachment: Tez-1493-2.patch Tez examples fail in recovery sometimes

[jira] [Commented] (TEZ-853) Support counters recovery

[ https://issues.apache.org/jira/browse/TEZ-853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14111581#comment-14111581 ] Jeff Zhang commented on TEZ-853: [~hitesh] Sorry for the typo in my last comment, it should

[jira] [Commented] (TEZ-1506) Possible statemachine bug : TaskAttemptImpl.handle()--Invalid event: TA_FAILED at SUCCEEDED

[ https://issues.apache.org/jira/browse/TEZ-1506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14112117#comment-14112117 ] Jeff Zhang commented on TEZ-1506: - [~rajesh.balamohan] I check the logs and find that

[jira] [Comment Edited] (TEZ-1506) Possible statemachine bug : TaskAttemptImpl.handle()--Invalid event: TA_FAILED at SUCCEEDED

[ https://issues.apache.org/jira/browse/TEZ-1506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14112117#comment-14112117 ] Jeff Zhang edited comment on TEZ-1506 at 8/27/14 10:49 AM: ---

[jira] [Commented] (TEZ-1345) Add checks to guarantee all init events are written to recovery to consider vertex initialized

[ https://issues.apache.org/jira/browse/TEZ-1345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14112176#comment-14112176 ] Jeff Zhang commented on TEZ-1345: - [~hitesh] Attach the new patch. * Move the route events

[jira] [Updated] (TEZ-1345) Add checks to guarantee all init events are written to recovery to consider vertex initialized

[ https://issues.apache.org/jira/browse/TEZ-1345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1345: Attachment: Tez-1345-2.patch Add checks to guarantee all init events are written to recovery to consider

[jira] [Commented] (TEZ-1345) Add checks to guarantee all init events are written to recovery to consider vertex initialized

[ https://issues.apache.org/jira/browse/TEZ-1345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14113363#comment-14113363 ] Jeff Zhang commented on TEZ-1345: - [~bikassaha] bq. Why are we calling VertexImpl method

[jira] [Comment Edited] (TEZ-1345) Add checks to guarantee all init events are written to recovery to consider vertex initialized

[ https://issues.apache.org/jira/browse/TEZ-1345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14113363#comment-14113363 ] Jeff Zhang edited comment on TEZ-1345 at 8/28/14 5:35 AM: --

[jira] [Commented] (TEZ-853) Support counters recovery

[ https://issues.apache.org/jira/browse/TEZ-853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14113433#comment-14113433 ] Jeff Zhang commented on TEZ-853: [~hitesh] bq. Do TaskImpl and VertexImpl write counters to

[jira] [Commented] (TEZ-1358) Display better diagnostics when tasks fail to launch

[ https://issues.apache.org/jira/browse/TEZ-1358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14113442#comment-14113442 ] Jeff Zhang commented on TEZ-1358: - [~hitesh] verify it that it will show up in the RM UI.

[jira] [Assigned] (TEZ-1357) Display better diagnostics when AM fails to launch

[ https://issues.apache.org/jira/browse/TEZ-1357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang reassigned TEZ-1357: --- Assignee: Jeff Zhang Display better diagnostics when AM fails to launch

[jira] [Updated] (TEZ-1521) VertexDataMovementEventsGeneratedEvent may be logged twice in recovery log

[ https://issues.apache.org/jira/browse/TEZ-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1521: Description: The TezEvents may be added to pendingTaskEvents when task is not scheduled. In this case,

[jira] [Updated] (TEZ-1521) VertexDataMovementEventsGeneratedEvent may be logged twice in recovery log

[ https://issues.apache.org/jira/browse/TEZ-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1521: Description: The TezEvents may be added to pendingTaskEvents when task is not scheduled. In this case,

[jira] [Updated] (TEZ-1521) VertexDataMovementEventsGeneratedEvent may be logged twice in recovery log

[ https://issues.apache.org/jira/browse/TEZ-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1521: Description: The TezEvents may be added to pendingTaskEvents and route again later when task is not

[jira] [Commented] (TEZ-1476) DAGClient waitForCompletion output is confusing

[ https://issues.apache.org/jira/browse/TEZ-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14115300#comment-14115300 ] Jeff Zhang commented on TEZ-1476: - [~seth.siddha...@gmail.com], [~jeagles] I notice that

[jira] [Updated] (TEZ-1345) Add checks to guarantee all init events are written to recovery to consider vertex initialized

[ https://issues.apache.org/jira/browse/TEZ-1345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1345: Attachment: Tez-1345-3.patch Add checks to guarantee all init events are written to recovery to consider

[jira] [Updated] (TEZ-1521) VertexDataMovementEventsGeneratedEvent may be logged twice in recovery log

[ https://issues.apache.org/jira/browse/TEZ-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1521: Issue Type: Sub-task (was: Bug) Parent: TEZ-15 VertexDataMovementEventsGeneratedEvent may be logged

[jira] [Commented] (TEZ-1527) Improvement on waitForCompletion API

[ https://issues.apache.org/jira/browse/TEZ-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14118997#comment-14118997 ] Jeff Zhang commented on TEZ-1527: - [~sseth] I was afraid that someone may use this api to

[jira] [Updated] (TEZ-1345) Add checks to guarantee all init events are written to recovery to consider vertex initialized

[ https://issues.apache.org/jira/browse/TEZ-1345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1345: Attachment: Tez-1345-6.patch Tez-1345-5.patch Add checks to guarantee all init events are

[jira] [Commented] (TEZ-1345) Add checks to guarantee all init events are written to recovery to consider vertex initialized

[ https://issues.apache.org/jira/browse/TEZ-1345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14119403#comment-14119403 ] Jeff Zhang commented on TEZ-1345: - [~hitesh] Attach 2 patches for the following 2 solutions:

[jira] [Updated] (TEZ-1527) Improvement on waitForCompletion API

[ https://issues.apache.org/jira/browse/TEZ-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1527: Attachment: Tez-1527.patch Improvement on waitForCompletion API

[jira] [Commented] (TEZ-1527) Improvement on waitForCompletion API

[ https://issues.apache.org/jira/browse/TEZ-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14119434#comment-14119434 ] Jeff Zhang commented on TEZ-1527: - [~seth.siddha...@gmail.com] Attach the patch. * add

[jira] [Updated] (TEZ-1527) Improvement on waitForCompletion API

[ https://issues.apache.org/jira/browse/TEZ-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1527: Attachment: Tez-1521-2.patch Improvement on waitForCompletion API

[jira] [Updated] (TEZ-1527) Improvement on waitForCompletion API

[ https://issues.apache.org/jira/browse/TEZ-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1527: Attachment: Tez-1527-2.patch Attach the file with right name Improvement on waitForCompletion API

[jira] [Updated] (TEZ-1499) Add OrderedJoinExample to tez-examples

[ https://issues.apache.org/jira/browse/TEZ-1499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1499: Attachment: Tez-1499.patch Add OrderedJoinExample to tez-examples --

[jira] [Commented] (TEZ-1499) Add OrderedJoinExample to tez-examples

[ https://issues.apache.org/jira/browse/TEZ-1499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14120670#comment-14120670 ] Jeff Zhang commented on TEZ-1499: - [~bikassaha] IMO, broadcast vs non-broadcast is very

[jira] [Updated] (TEZ-850) Recovery unit tests

[ https://issues.apache.org/jira/browse/TEZ-850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-850: --- Attachment: Tez-850-2.patch Attach the new patch (rebase it to latest commit) Recovery unit tests

[jira] [Commented] (TEZ-1345) Add checks to guarantee all init events are written to recovery to consider vertex initialized

[ https://issues.apache.org/jira/browse/TEZ-1345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14121307#comment-14121307 ] Jeff Zhang commented on TEZ-1345: - [~bikassaha], [~hitesh] Thanks for your comments. The

[jira] [Updated] (TEZ-1345) Add checks to guarantee all init events are written to recovery to consider vertex initialized

[ https://issues.apache.org/jira/browse/TEZ-1345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1345: Attachment: Tez-1345-8.patch Attach new patch (revert the api compatibility issue of last patch) Add checks

[jira] [Updated] (TEZ-1384) Move recovery related code into inner class

[ https://issues.apache.org/jira/browse/TEZ-1384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1384: Attachment: Tez-1384-2.patch Move recovery related code into inner class

[jira] [Commented] (TEZ-1384) Move recovery related code into inner class

[ https://issues.apache.org/jira/browse/TEZ-1384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14122840#comment-14122840 ] Jeff Zhang commented on TEZ-1384: - [~hitesh] Attach the patch * Create a base class

[jira] [Commented] (TEZ-1539) Allow a FIRE_ONCE_ON_SUCCESS model for events generated by user code

[ https://issues.apache.org/jira/browse/TEZ-1539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14126311#comment-14126311 ] Jeff Zhang commented on TEZ-1539: - [~hitesh] Will look at it today Allow a

  1   2   3   4   5   6   7   8   9   10   >