[jira] [Comment Edited] (TEZ-714) OutputCommitters should not run in the main AM dispatcher thread

2015-03-25 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14379904#comment-14379904 ] Jeff Zhang edited comment on TEZ-714 at 3/25/15 3:04 PM: - Upload new

[jira] [Updated] (TEZ-714) OutputCommitters should not run in the main AM dispatcher thread

2015-03-25 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-714: --- Attachment: TEZ-714-4.patch OutputCommitters should not run in the main AM dispatcher thread

[jira] [Comment Edited] (TEZ-714) OutputCommitters should not run in the main AM dispatcher thread

2015-03-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14386086#comment-14386086 ] Jeff Zhang edited comment on TEZ-714 at 3/30/15 3:14 AM: - bq. This is

[jira] [Updated] (TEZ-2250) Consolidate the Internal Error transition for DAG/Verex/Task/TaskAttempt

2015-03-30 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2250: Description: Currently, invalid state machine transition will trigger the internal error. Here's current

[jira] [Comment Edited] (TEZ-714) OutputCommitters should not run in the main AM dispatcher thread

2015-03-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14386086#comment-14386086 ] Jeff Zhang edited comment on TEZ-714 at 3/30/15 2:28 AM: - bq. This is

[jira] [Comment Edited] (TEZ-714) OutputCommitters should not run in the main AM dispatcher thread

2015-03-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14386113#comment-14386113 ] Jeff Zhang edited comment on TEZ-714 at 3/30/15 2:47 AM: - Regarding

[jira] [Issue Comment Deleted] (TEZ-714) OutputCommitters should not run in the main AM dispatcher thread

2015-03-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-714: --- Comment: was deleted (was: Regarding the partial output, After second thought, I think we should only consider

[jira] [Commented] (TEZ-714) OutputCommitters should not run in the main AM dispatcher thread

2015-03-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14386113#comment-14386113 ] Jeff Zhang commented on TEZ-714: Regarding the partial output, After second thought, I think

[jira] [Comment Edited] (TEZ-714) OutputCommitters should not run in the main AM dispatcher thread

2015-03-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14386113#comment-14386113 ] Jeff Zhang edited comment on TEZ-714 at 3/30/15 2:45 AM: - Regarding

[jira] [Comment Edited] (TEZ-714) OutputCommitters should not run in the main AM dispatcher thread

2015-03-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14386113#comment-14386113 ] Jeff Zhang edited comment on TEZ-714 at 3/30/15 2:46 AM: - Regarding

[jira] [Created] (TEZ-2250) Consolidate the Internal Error transition for DAG/Verex/Task/TaskAttempt

2015-03-30 Thread Jeff Zhang (JIRA)
Jeff Zhang created TEZ-2250: --- Summary: Consolidate the Internal Error transition for DAG/Verex/Task/TaskAttempt Key: TEZ-2250 URL: https://issues.apache.org/jira/browse/TEZ-2250 Project: Apache Tez

[jira] [Comment Edited] (TEZ-714) OutputCommitters should not run in the main AM dispatcher thread

2015-03-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14386086#comment-14386086 ] Jeff Zhang edited comment on TEZ-714 at 3/30/15 2:15 AM: - bq. This is

[jira] [Comment Edited] (TEZ-714) OutputCommitters should not run in the main AM dispatcher thread

2015-03-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14386086#comment-14386086 ] Jeff Zhang edited comment on TEZ-714 at 3/30/15 3:18 AM: - bq. This is

[jira] [Updated] (TEZ-2250) Consolidate the Internal Error transition for DAG/Verex/Task/TaskAttempt

2015-03-30 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2250: Description: Currently, invalid state machine transition will trigger the internal error. Here's current

[jira] [Comment Edited] (TEZ-714) OutputCommitters should not run in the main AM dispatcher thread

2015-03-30 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14386086#comment-14386086 ] Jeff Zhang edited comment on TEZ-714 at 3/30/15 7:03 AM: - bq. This is

[jira] [Created] (TEZ-2249) Wait for all task attempt finished before moving Task to finished state

2015-03-29 Thread Jeff Zhang (JIRA)
Jeff Zhang created TEZ-2249: --- Summary: Wait for all task attempt finished before moving Task to finished state Key: TEZ-2249 URL: https://issues.apache.org/jira/browse/TEZ-2249 Project: Apache Tez

[jira] [Commented] (TEZ-2224) EventQueue empty doesn't mean events are consumed in RecoveryService

2015-03-30 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14386486#comment-14386486 ] Jeff Zhang commented on TEZ-2224: - Upload new patch, [~hitesh] Please help review. bq. Is

[jira] [Issue Comment Deleted] (TEZ-2224) EventQueue empty doesn't mean events are consumed in RecoveryService

2015-03-30 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2224: Comment: was deleted (was: bq. Is there a reason why we want to prevent new events from being processed on a

[jira] [Commented] (TEZ-1909) Remove need to copy over all events from attempt 1 to attempt 2 dir

2015-03-30 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14387888#comment-14387888 ] Jeff Zhang commented on TEZ-1909: - [~hitesh] Upload new patch, please help review it. *

[jira] [Updated] (TEZ-2224) EventQueue empty doesn't mean events are consumed in RecoveryService

2015-03-30 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2224: Fix Version/s: 0.6.1 0.7.0 EventQueue empty doesn't mean events are consumed in

[jira] [Commented] (TEZ-2224) EventQueue empty doesn't mean events are consumed in RecoveryService

2015-03-30 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14387776#comment-14387776 ] Jeff Zhang commented on TEZ-2224: - Thanks [~hitesh] Committed it to branch-0.5, branch-0.6

[jira] [Updated] (TEZ-1909) Remove need to copy over all events from attempt 1 to attempt 2 dir

2015-03-30 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1909: Attachment: TEZ-1909-4.patch Remove need to copy over all events from attempt 1 to attempt 2 dir

[jira] [Commented] (TEZ-2253) TestMockDAGAppMaster::testBasicCounters fails on OS X

2015-03-30 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14387637#comment-14387637 ] Jeff Zhang commented on TEZ-2253: - [~hitesh] I have the same issue, and already created

[jira] [Commented] (TEZ-2224) EventQueue empty doesn't mean events are consumed in RecoveryService

2015-03-31 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388252#comment-14388252 ] Jeff Zhang commented on TEZ-2224: - Build fails, checking that

[jira] [Commented] (TEZ-2224) EventQueue empty doesn't mean events are consumed in RecoveryService

2015-03-31 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388156#comment-14388156 ] Jeff Zhang commented on TEZ-2224: - Thanks [~cchepelov] I am looking at it. EventQueue

[jira] [Updated] (TEZ-2224) EventQueue empty doesn't mean events are consumed in RecoveryService

2015-03-31 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2224: Attachment: TEZ-2224-2-addendum.patch Attach addendum patch for fix compilation issue in branch-0.5

[jira] [Commented] (TEZ-2224) EventQueue empty doesn't mean events are consumed in RecoveryService

2015-03-31 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388157#comment-14388157 ] Jeff Zhang commented on TEZ-2224: - Thanks [~cchepelov] I am looking at it. EventQueue

[jira] [Comment Edited] (TEZ-2224) EventQueue empty doesn't mean events are consumed in RecoveryService

2015-03-31 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388186#comment-14388186 ] Jeff Zhang edited comment on TEZ-2224 at 3/31/15 7:44 AM: -- Attach

[jira] [Reopened] (TEZ-2224) EventQueue empty doesn't mean events are consumed in RecoveryService

2015-03-31 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang reopened TEZ-2224: - EventQueue empty doesn't mean events are consumed in RecoveryService

[jira] [Commented] (TEZ-2149) Optimizations for the timed version of DAGClient.getStatus

2015-03-31 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388295#comment-14388295 ] Jeff Zhang commented on TEZ-2149: - Build fails

[jira] [Commented] (TEZ-714) OutputCommitters should not run in the main AM dispatcher thread

2015-03-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14386086#comment-14386086 ] Jeff Zhang commented on TEZ-714: bq. This is a known issue. There is a comment somewhere in

[jira] [Commented] (TEZ-714) OutputCommitters should not run in the main AM dispatcher thread

2015-03-31 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388448#comment-14388448 ] Jeff Zhang commented on TEZ-714: [~bikassaha] Minor update on the patch. * Please ignore any

[jira] [Updated] (TEZ-714) OutputCommitters should not run in the main AM dispatcher thread

2015-03-31 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-714: --- Attachment: TEZ-714-7.patch Rebase patch. OutputCommitters should not run in the main AM dispatcher thread

[jira] [Commented] (TEZ-2260) AM been shutdown due to NoSuchMethodError in DAGProtos

2015-03-31 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14389882#comment-14389882 ] Jeff Zhang commented on TEZ-2260: - Create TEZ-2261 for adding diagnostics in DAGAppMaster

[jira] [Created] (TEZ-2261) Should add diagnostics in DAGAppMaster when recovery error happens

2015-03-31 Thread Jeff Zhang (JIRA)
Jeff Zhang created TEZ-2261: --- Summary: Should add diagnostics in DAGAppMaster when recovery error happens Key: TEZ-2261 URL: https://issues.apache.org/jira/browse/TEZ-2261 Project: Apache Tez

[jira] [Updated] (TEZ-2260) AM been shutdown due to NoSuchMethodError in DAGProtos

2015-03-31 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2260: Attachment: applog.tar attach the full app logs when running TestTezJobs.testSortMergeJoinExamplePipeline

[jira] [Commented] (TEZ-2192) Relocalization does not check for source

2015-04-01 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390296#comment-14390296 ] Jeff Zhang commented on TEZ-2192: - * Is the firstContainerSignature still necessary ? It

[jira] [Updated] (TEZ-714) OutputCommitters should not run in the main AM dispatcher thread

2015-03-27 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-714: --- Attachment: TEZ-714-5.patch OutputCommitters should not run in the main AM dispatcher thread

[jira] [Commented] (TEZ-714) OutputCommitters should not run in the main AM dispatcher thread

2015-03-27 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14383586#comment-14383586 ] Jeff Zhang commented on TEZ-714: Upload new patch to address the review comment. * Why is

[jira] [Commented] (TEZ-2224) EventQueue empty doesn't mean events are consumed in RecoveryService

2015-03-31 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14389698#comment-14389698 ] Jeff Zhang commented on TEZ-2224: - [~hitesh] I am looking at this. The build fails may due

[jira] [Updated] (TEZ-2219) Should verify the input_name/output_name to be unique per vertex

2015-03-22 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2219: Attachment: TEZ-2219-2.patch Upload new patch to address the review comments. [~hitesh] Please help review

[jira] [Updated] (TEZ-2219) Should verify the input_name/output_name to be unique

2015-03-22 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2219: Issue Type: Improvement (was: Bug) Should verify the input_name/output_name to be unique

[jira] [Updated] (TEZ-2219) Should verify the input_name/output_name to be unique per vertex

2015-03-22 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2219: Summary: Should verify the input_name/output_name to be unique per vertex (was: Should verify the

[jira] [Created] (TEZ-2221) VertexGroup name should be unqiue

2015-03-22 Thread Jeff Zhang (JIRA)
Jeff Zhang created TEZ-2221: --- Summary: VertexGroup name should be unqiue Key: TEZ-2221 URL: https://issues.apache.org/jira/browse/TEZ-2221 Project: Apache Tez Issue Type: Bug Reporter:

[jira] [Updated] (TEZ-2219) Should verify the input_name/output_name to be unique per vertex

2015-03-22 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2219: Attachment: TEZ-2219-3.patch Upload new patch. Should verify the input_name/output_name to be unique per

[jira] [Comment Edited] (TEZ-2219) Should verify the input_name/output_name to be unique per vertex

2015-03-22 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375436#comment-14375436 ] Jeff Zhang edited comment on TEZ-2219 at 3/23/15 5:58 AM: -- Upload

[jira] [Commented] (TEZ-2110) Display locality info on tez-ui

2015-03-02 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14344168#comment-14344168 ] Jeff Zhang commented on TEZ-2110: - I mean add locality info for each task attempt, and

[jira] [Updated] (TEZ-1909) Remove need to copy over all events from attempt 1 to attempt 2 dir

2015-02-27 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1909: Attachment: TEZ-1909-1.patch Remove need to copy over all events from attempt 1 to attempt 2 dir

[jira] [Assigned] (TEZ-2163) Task status update should be handled in the START_WAIT state

2015-03-03 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang reassigned TEZ-2163: --- Assignee: Jeff Zhang Task status update should be handled in the START_WAIT state

[jira] [Updated] (TEZ-2163) Task status update should be handled in the START_WAIT state

2015-03-03 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2163: Attachment: TEZ-2163-1.patch Upload patch to address this issue, besides also remove some unnecessary code

[jira] [Commented] (TEZ-2162) org.apache.hadoop.mapreduce.lib.output.SequenceFileOutputFormat is not recognized

2015-03-03 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14346425#comment-14346425 ] Jeff Zhang commented on TEZ-2162: - [~hitesh] [~bikassaha] [~sseth] Mind review it ?

[jira] [Updated] (TEZ-2162) org.apache.hadoop.mapreduce.lib.output.SequenceFileOutputFormat is not recognized

2015-03-01 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2162: Attachment: TEZ-2162-1.patch Attach the patch.

[jira] [Assigned] (TEZ-2162) org.apache.hadoop.mapreduce.lib.output.SequenceFileOutputFormat is not recognized

2015-03-01 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang reassigned TEZ-2162: --- Assignee: Jeff Zhang org.apache.hadoop.mapreduce.lib.output.SequenceFileOutputFormat is not

[jira] [Updated] (TEZ-2162) org.apache.hadoop.mapreduce.lib.output.SequenceFileOutputFormat is not recognized

2015-03-01 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2162: Priority: Critical (was: Major) org.apache.hadoop.mapreduce.lib.output.SequenceFileOutputFormat is not

[jira] [Comment Edited] (TEZ-2162) org.apache.hadoop.mapreduce.lib.output.SequenceFileOutputFormat is not recognized

2015-03-01 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14342683#comment-14342683 ] Jeff Zhang edited comment on TEZ-2162 at 3/2/15 3:54 AM: - Attach the

[jira] [Commented] (TEZ-1019) Re-factor routing of events to use common code path for normal and recovery flow.

2015-02-26 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14338228#comment-14338228 ] Jeff Zhang commented on TEZ-1019: - [~hitesh] Thanks for review, attach new patch to address

[jira] [Commented] (TEZ-2148) Slow container grabbing with Capacity Scheduler in comparision to MapReduce

2015-02-26 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14338269#comment-14338269 ] Jeff Zhang commented on TEZ-2148: - Quickly go through the logs, and found that tez use 280

[jira] [Updated] (TEZ-2148) Slow container grabbing with Capacity Scheduler in comparision to MapReduce

2015-02-26 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2148: Attachment: dag4.pdf dag3.pdf dag2.pdf dag1.pdf attach the 4

[jira] [Commented] (TEZ-2221) VertexGroup name should be unqiue

2015-03-23 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14377330#comment-14377330 ] Jeff Zhang commented on TEZ-2221: - In the previous testcase we compare vertex group by using

[jira] [Commented] (TEZ-2221) VertexGroup name should be unqiue

2015-03-23 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14377323#comment-14377323 ] Jeff Zhang commented on TEZ-2221: - bq. This should also be disallowed. Correct? Yes, it is

[jira] [Updated] (TEZ-2204) TestAMRecovery increasingly flaky on jenkins builds.

2015-03-24 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2204: Attachment: TEZ-2204-5.patch Upload new patch with minor change (add one more log) TestAMRecovery

[jira] [Updated] (TEZ-2207) TEZ-UI Highlight the selected row in Counter view

2015-03-18 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2207: Summary: TEZ-UI Highlight the selected row in Counter view (was: TEZ-Ui Highlight the selected row in

[jira] [Updated] (TEZ-2207) TEZ-Ui Highlight the selected row in Counter view

2015-03-18 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2207: Issue Type: Improvement (was: Bug) TEZ-Ui Highlight the selected row in Counter view

[jira] [Created] (TEZ-2207) TEZ-Ui Highlight the selected row in Counter view

2015-03-18 Thread Jeff Zhang (JIRA)
Jeff Zhang created TEZ-2207: --- Summary: TEZ-Ui Highlight the selected row in Counter view Key: TEZ-2207 URL: https://issues.apache.org/jira/browse/TEZ-2207 Project: Apache Tez Issue Type: Bug

[jira] [Commented] (TEZ-2105) Totally Sorted Edge with auto-parallelism

2015-03-06 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14350128#comment-14350128 ] Jeff Zhang commented on TEZ-2105: - [~shanaka.kuruwita] Glad to know you are interested in

[jira] [Commented] (TEZ-2192) Relocalization does not check for source

2015-03-27 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14384942#comment-14384942 ] Jeff Zhang commented on TEZ-2192: - [~hitesh] Feel free to take it, I am not working on this

[jira] [Updated] (TEZ-391) SharedEdge - Support for passing same output from a vertex as input to two different vertices

2015-01-25 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-391: --- Attachment: TEZ-391-WIP-3.patch Rebased the patch to enable the precommit build SharedEdge - Support for

[jira] [Commented] (TEZ-2000) Source vertex exists error during DAG submission

2015-01-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14298225#comment-14298225 ] Jeff Zhang commented on TEZ-2000: - [~sseth] Thanks for review, committed to master. For the

[jira] [Commented] (TEZ-993) Remove application logic from RecoveryService

2015-01-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14298287#comment-14298287 ] Jeff Zhang commented on TEZ-993: bq. This will imply that all the events will still be sent

[jira] [Updated] (TEZ-1895) Vertex reRunning should decrease successfulMembers of VertexGroupInfo

2015-01-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1895: Attachment: TEZ-1895-3.patch Vertex reRunning should decrease successfulMembers of VertexGroupInfo

[jira] [Commented] (TEZ-2000) Source vertex exists error during DAG submission

2015-01-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14298219#comment-14298219 ] Jeff Zhang commented on TEZ-2000: - Looks like my configuration issue, can run the pig e2e

[jira] [Updated] (TEZ-993) Remove application logic from RecoveryService

2015-01-30 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-993: --- Attachment: TEZ-993-5.patch Upload new patch to address the findbugs warnings. Remove application logic from

[jira] [Updated] (TEZ-993) Remove application logic from RecoveryService

2015-01-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-993: --- Attachment: TEZ-993-4.patch Rebase the patch. Remove application logic from RecoveryService

[jira] [Commented] (TEZ-1895) Vertex reRunning should decrease successfulMembers of VertexGroupInfo

2015-01-30 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14298522#comment-14298522 ] Jeff Zhang commented on TEZ-1895: - bq. Was this added because the new tests revealed the bug

[jira] [Updated] (TEZ-1895) Vertex reRunning should decrease successfulMembers of VertexGroupInfo

2015-01-30 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-1895: Attachment: TEZ-1895-4.patch Vertex reRunning should decrease successfulMembers of VertexGroupInfo

[jira] [Commented] (TEZ-714) OutputCommitters should not run in the main AM dispatcher thread

2015-03-23 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375512#comment-14375512 ] Jeff Zhang commented on TEZ-714: Upload a new patch. [~bikassaha] Please help review it. *

[jira] [Commented] (TEZ-2219) Should verify the input_name/output_name to be unique per vertex

2015-03-23 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375485#comment-14375485 ] Jeff Zhang commented on TEZ-2219: - Thanks [~hitesh] Committed to master, branch-0.5,

[jira] [Updated] (TEZ-714) OutputCommitters should not run in the main AM dispatcher thread

2015-03-23 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-714: --- Attachment: TEZ-714-2.patch OutputCommitters should not run in the main AM dispatcher thread

[jira] [Updated] (TEZ-2204) TestAMRecovery increasingly flaky on jenkins builds.

2015-03-23 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2204: Attachment: TEZ-2204-3.patch TestAMRecovery increasingly flaky on jenkins builds.

[jira] [Commented] (TEZ-2204) TestAMRecovery increasingly flaky on jenkins builds.

2015-03-23 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14377018#comment-14377018 ] Jeff Zhang commented on TEZ-2204: - Upload new patch (exclude the findbugs warning )

[jira] [Updated] (TEZ-2204) TestAMRecovery increasingly flaky on jenkins builds.

2015-03-23 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2204: Attachment: TEZ-2204-4.patch Minor update on the patch TestAMRecovery increasingly flaky on jenkins builds.

[jira] [Updated] (TEZ-2223) TestMockDAGAppMaster fails due to TEZ-2210 on mac

2015-03-23 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2223: Summary: TestMockDAGAppMaster fails due to TEZ-2210 on mac (was: TestMockDAGAppMaster fails due to TEZ-2210)

[jira] [Updated] (TEZ-2223) TestMockDAGAppMaster fails due to TEZ-2210

2015-03-23 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2223: Description: [~bikassaha] looks like TestMockDAGAppMaster fails due to TEZ-2210 It would fail on mac due to

[jira] [Updated] (TEZ-2221) VertexGroup name should be unqiue

2015-03-23 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2221: Attachment: TEZ-2221-1.patch VertexGroup name should be unqiue -

[jira] [Commented] (TEZ-714) OutputCommitters should not run in the main AM dispatcher thread

2015-03-23 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14377209#comment-14377209 ] Jeff Zhang commented on TEZ-714: bq. Can this be fixed by having the events for both be

[jira] [Created] (TEZ-2223) TestMockDAGAppMaster fails due to TEZ-2210

2015-03-23 Thread Jeff Zhang (JIRA)
Jeff Zhang created TEZ-2223: --- Summary: TestMockDAGAppMaster fails due to TEZ-2210 Key: TEZ-2223 URL: https://issues.apache.org/jira/browse/TEZ-2223 Project: Apache Tez Issue Type: Bug

[jira] [Updated] (TEZ-2261) Should add diagnostics in DAGAppMaster when recovery error happens

2015-04-01 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2261: Attachment: TEZ-2261-1.patch Should add diagnostics in DAGAppMaster when recovery error happens

[jira] [Commented] (TEZ-2192) Relocalization does not check for source

2015-04-02 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392400#comment-14392400 ] Jeff Zhang commented on TEZ-2192: - Regarding the sample job, maybe we can check the local

[jira] [Updated] (TEZ-2267) Deadlock caused by TEZ-2149

2015-04-02 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2267: Description: {code} TaskSchedulerAppCaller #0 daemon prio=10 tid=0x7f044005e800 nid=0x7be6 waiting on

[jira] [Created] (TEZ-2267) Deadlock caused by TEZ-2149

2015-04-02 Thread Jeff Zhang (JIRA)
Jeff Zhang created TEZ-2267: --- Summary: Deadlock caused by TEZ-2149 Key: TEZ-2267 URL: https://issues.apache.org/jira/browse/TEZ-2267 Project: Apache Tez Issue Type: Bug Reporter: Jeff

[jira] [Updated] (TEZ-2267) Deadlock caused by TEZ-2149

2015-04-02 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2267: Priority: Critical (was: Major) Deadlock caused by TEZ-2149 ---

[jira] [Updated] (TEZ-2267) Deadlock caused by TEZ-2149

2015-04-02 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2267: Description: {code} TaskSchedulerAppCaller #0 daemon prio=10 tid=0x7f044005e800 nid=0x7be6 waiting on

[jira] [Updated] (TEZ-2267) Deadlock caused by TEZ-2149

2015-04-02 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2267: Attachment: jstack.txt attach the full jstack trace Deadlock caused by TEZ-2149

[jira] [Commented] (TEZ-2267) Deadlock caused by TEZ-2149

2015-04-02 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394009#comment-14394009 ] Jeff Zhang commented on TEZ-2267: - [~sseth] Reproduce it again and attach the jstack trace

[jira] [Commented] (TEZ-2192) Relocalization does not check for source

2015-04-02 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393734#comment-14393734 ] Jeff Zhang commented on TEZ-2192: - [~hitesh] Got it, I think it is OK if it's only for

[jira] [Updated] (TEZ-2267) Deadlock caused by TEZ-2149

2015-04-02 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2267: Attachment: syslog_dag_1427965027460_0001_1 jstack2.txt Deadlock caused by TEZ-2149

[jira] [Created] (TEZ-2271) OutputFormat is not recognized correctly

2015-04-03 Thread Jeff Zhang (JIRA)
Jeff Zhang created TEZ-2271: --- Summary: OutputFormat is not recognized correctly Key: TEZ-2271 URL: https://issues.apache.org/jira/browse/TEZ-2271 Project: Apache Tez Issue Type: Bug

[jira] [Updated] (TEZ-2271) OutputFormat is not recognized correctly

2015-04-03 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2271: Priority: Critical (was: Major) OutputFormat is not recognized correctly

[jira] [Updated] (TEZ-2272) Should display committer for Output (Sink)

2015-04-03 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2272: Attachment: initializer_committer.png Should display committer for Output (Sink)

[jira] [Updated] (TEZ-2272) Should display committer for Output (Sink)

2015-04-03 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2272: Summary: Should display committer for Output (Sink) (was: Should add committer for Output (Sink)) Should

<    5   6   7   8   9   10   11   12   13   14   >