[jira] [Commented] (TEZ-2188) Verify vertex with bipartite source vertex and root input in client side

2015-04-29 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520924#comment-14520924 ] TezQA commented on TEZ-2188: {color:green}+1 overall{color}. Here are the results of testing th

Success: TEZ-2188 PreCommit Build #587

2015-04-29 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-2188 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/587/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated

[jira] [Updated] (TEZ-2188) Verify vertex with bipartite source vertex and root input in client side

2015-04-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2188: Attachment: TEZ-2188-2.patch Rebase the patch, [~bikassaha] Please help review it. > Verify vertex with bipar

[jira] [Commented] (TEZ-2221) VertexGroup name should be unqiue

2015-04-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520871#comment-14520871 ] Jeff Zhang commented on TEZ-2221: - Thanks [~hitesh] Committed to branch-0.5, branch-0.6 & ma

[jira] [Commented] (TEZ-1521) VertexDataMovementEventsGeneratedEvent may be logged twice in recovery log

2015-04-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520858#comment-14520858 ] Jeff Zhang commented on TEZ-1521: - Thanks [~hitesh] Committed to branch-0.5, branch-0.6 & ma

[jira] [Comment Edited] (TEZ-776) Reduce AM mem usage caused by storing TezEvents

2015-04-29 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520833#comment-14520833 ] Siddharth Seth edited comment on TEZ-776 at 4/30/15 4:19 AM: - Som

[jira] [Comment Edited] (TEZ-776) Reduce AM mem usage caused by storing TezEvents

2015-04-29 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520833#comment-14520833 ] Siddharth Seth edited comment on TEZ-776 at 4/30/15 4:19 AM: - Som

[jira] [Commented] (TEZ-776) Reduce AM mem usage caused by storing TezEvents

2015-04-29 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520833#comment-14520833 ] Siddharth Seth commented on TEZ-776: Some numbers form various runs. All of these are on

[jira] [Commented] (TEZ-2221) VertexGroup name should be unqiue

2015-04-29 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520828#comment-14520828 ] TezQA commented on TEZ-2221: {color:green}+1 overall{color}. Here are the results of testing th

Success: TEZ-2221 PreCommit Build #586

2015-04-29 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-2221 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/586/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated

[jira] [Commented] (TEZ-776) Reduce AM mem usage caused by storing TezEvents

2015-04-29 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520815#comment-14520815 ] Siddharth Seth commented on TEZ-776: >From another offline discussion to resolve the issu

[jira] [Commented] (TEZ-2221) VertexGroup name should be unqiue

2015-04-29 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520806#comment-14520806 ] Hitesh Shah commented on TEZ-2221: -- +1 pending pre-commit > VertexGroup name should be un

[jira] [Updated] (TEZ-2221) VertexGroup name should be unqiue

2015-04-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2221: Attachment: TEZ-2221-4.patch Upload new patch to address the review comments > VertexGroup name should be unq

[jira] [Created] (TEZ-2393) Tez pickup PATH env from gateway machine

2015-04-29 Thread Daniel Dai (JIRA)
Daniel Dai created TEZ-2393: --- Summary: Tez pickup PATH env from gateway machine Key: TEZ-2393 URL: https://issues.apache.org/jira/browse/TEZ-2393 Project: Apache Tez Issue Type: Bug Rep

[jira] [Commented] (TEZ-2360) per-io counters flag should generate both overall and per-edge counters

2015-04-29 Thread Prakash Ramachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520766#comment-14520766 ] Prakash Ramachandran commented on TEZ-2360: --- thanks [~bikassaha] / [~sseth] bq. I

[jira] [Commented] (TEZ-2221) VertexGroup name should be unqiue

2015-04-29 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520758#comment-14520758 ] TezQA commented on TEZ-2221: {color:red}-1 overall{color}. Here are the results of testing the

Failed: TEZ-776 PreCommit Build #585

2015-04-29 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-776 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/585/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 2

Failed: TEZ-2221 PreCommit Build #584

2015-04-29 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-2221 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/584/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated

[jira] [Commented] (TEZ-776) Reduce AM mem usage caused by storing TezEvents

2015-04-29 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520753#comment-14520753 ] TezQA commented on TEZ-776: --- {color:red}-1 overall{color}. Here are the results of testing the lat

[jira] [Commented] (TEZ-2221) VertexGroup name should be unqiue

2015-04-29 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520743#comment-14520743 ] Hitesh Shah commented on TEZ-2221: -- Comments: {code} private Set> vertexGroupMemberSets =

[jira] [Commented] (TEZ-1521) VertexDataMovementEventsGeneratedEvent may be logged twice in recovery log

2015-04-29 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520738#comment-14520738 ] Hitesh Shah commented on TEZ-1521: -- Yes that makes sense. I was looking to see if there wa

[jira] [Commented] (TEZ-1560) Invalid state machine handling for V_SOURCE_VERTEX_RECOVERED in recovery

2015-04-29 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520734#comment-14520734 ] Hitesh Shah commented on TEZ-1560: -- Thanks [~zjffdu] > Invalid state machine handling for

[jira] [Commented] (TEZ-776) Reduce AM mem usage caused by storing TezEvents

2015-04-29 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520724#comment-14520724 ] Siddharth Seth commented on TEZ-776: That's still making more changes which belong to oth

[jira] [Updated] (TEZ-776) Reduce AM mem usage caused by storing TezEvents

2015-04-29 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-776: --- Attachment: TEZ-776.7.patch > Reduce AM mem usage caused by storing TezEvents > -

[jira] [Updated] (TEZ-776) Reduce AM mem usage caused by storing TezEvents

2015-04-29 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-776: --- Attachment: (was: TEZ-776.7.patch) > Reduce AM mem usage caused by storing TezEvents > --

[jira] [Updated] (TEZ-776) Reduce AM mem usage caused by storing TezEvents

2015-04-29 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated TEZ-776: --- Attachment: TEZ-776.7.patch New patch to address review comments. Also added missing test case for exception pro

[jira] [Commented] (TEZ-2386) Tez UI: Inconsistent usage of icon colors

2015-04-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520717#comment-14520717 ] Jeff Zhang commented on TEZ-2386: - +1 on the java code part > Tez UI: Inconsistent usage of

[jira] [Commented] (TEZ-2221) VertexGroup name should be unqiue

2015-04-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520714#comment-14520714 ] Jeff Zhang commented on TEZ-2221: - [~hitesh] Sorry for response late. Upload new patch to

[jira] [Updated] (TEZ-2221) VertexGroup name should be unqiue

2015-04-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2221: Attachment: TEZ-2221-3.patch > VertexGroup name should be unqiue > - > >

[jira] [Commented] (TEZ-1521) VertexDataMovementEventsGeneratedEvent may be logged twice in recovery log

2015-04-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520693#comment-14520693 ] Jeff Zhang commented on TEZ-1521: - [~hitesh] The root_input_data_information_event may be ro

[jira] [Comment Edited] (TEZ-1560) Invalid state machine handling for V_SOURCE_VERTEX_RECOVERED in recovery

2015-04-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520675#comment-14520675 ] Jeff Zhang edited comment on TEZ-1560 at 4/30/15 1:28 AM: -- [~hitesh

[jira] [Commented] (TEZ-1560) Invalid state machine handling for V_SOURCE_VERTEX_RECOVERED in recovery

2015-04-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520675#comment-14520675 ] Jeff Zhang commented on TEZ-1560: - [~hitesh] I have fix the conflict and committed to branch

[jira] [Updated] (TEZ-2305) MR compatibility sleep job fails with IOException: Undefined job output-path

2015-04-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated TEZ-2305: Target Version/s: 0.7.0, 0.5.4, 0.6.1 (was: 0.5.4, 0.6.1) Fix Version/s: 0.7.0 > MR compatibility slee

[jira] [Commented] (TEZ-776) Reduce AM mem usage caused by storing TezEvents

2015-04-29 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520628#comment-14520628 ] Bikas Saha commented on TEZ-776: Please look at patch B. That is where I am making bug fixes

[jira] [Updated] (TEZ-2221) VertexGroup name should be unqiue

2015-04-29 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-2221: - Target Version/s: 0.7.0, 0.5.4, 0.6.1 (was: 0.5.4, 0.6.1) > VertexGroup name should be unqiue > ---

[jira] [Updated] (TEZ-1521) VertexDataMovementEventsGeneratedEvent may be logged twice in recovery log

2015-04-29 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1521: - Target Version/s: 0.7.0, 0.5.4, 0.6.1 (was: 0.5.4) > VertexDataMovementEventsGeneratedEvent may be logged t

[jira] [Updated] (TEZ-2188) Verify vertex with bipartite source vertex and root input in client side

2015-04-29 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-2188: - Target Version/s: 0.7.0, 0.5.4, 0.6.1 (was: 0.5.4) > Verify vertex with bipartite source vertex and root in

[jira] [Updated] (TEZ-2383) Cleanup input/output/processor contexts in LogicalIOProcessorRuntimeTask

2015-04-29 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-2383: -- Summary: Cleanup input/output/processor contexts in LogicalIOProcessorRuntimeTask (was: release s

[jira] [Commented] (TEZ-2383) release sort buffers on close

2015-04-29 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520569#comment-14520569 ] TezQA commented on TEZ-2383: {color:green}+1 overall{color}. Here are the results of testing th

Success: TEZ-2383 PreCommit Build #583

2015-04-29 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-2383 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/583/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated

[jira] [Commented] (TEZ-776) Reduce AM mem usage caused by storing TezEvents

2015-04-29 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520568#comment-14520568 ] Siddharth Seth commented on TEZ-776: Quick note. In process of looking at the .A patch. L

[jira] [Created] (TEZ-2392) Have all readers throw an Exception on incorrect next() usage

2015-04-29 Thread Siddharth Seth (JIRA)
Siddharth Seth created TEZ-2392: --- Summary: Have all readers throw an Exception on incorrect next() usage Key: TEZ-2392 URL: https://issues.apache.org/jira/browse/TEZ-2392 Project: Apache Tez I

[jira] [Commented] (TEZ-2383) release sort buffers on close

2015-04-29 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520559#comment-14520559 ] Siddharth Seth commented on TEZ-2383: - +1. Looks good. Thanks [~rajesh.balamohan] > rel

[jira] [Resolved] (TEZ-2377) RandomWriter ends up using TextOutputFormat instead of SequenceFileOutputFormat

2015-04-29 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan resolved TEZ-2377. --- Resolution: Duplicate Fix Version/s: 0.7.0 Fixed already as apart of TEZ-2305. > RandomW

[jira] [Resolved] (TEZ-2348) EOF exception during UnorderedKVReader.next()

2015-04-29 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan resolved TEZ-2348. --- Resolution: Fixed Fix Version/s: 0.5.4 Hadoop Flags: Reviewed Committed to master; 0

[jira] [Commented] (TEZ-2348) EOF exception during UnorderedKVReader.next()

2015-04-29 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520518#comment-14520518 ] Rajesh Balamohan commented on TEZ-2348: --- Thanks [~sseth], [~gopalv], [~hitesh]. Will

[jira] [Commented] (TEZ-2256) Avoid use of BufferTooSmallException to signal end of buffer in UnorderedPartitionedKVWriter

2015-04-29 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520511#comment-14520511 ] Hitesh Shah commented on TEZ-2256: -- Thanks [~cchepelov]. [~rajesh.balamohan] Do you plan t

[jira] [Updated] (TEZ-2221) VertexGroup name should be unqiue

2015-04-29 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-2221: - Target Version/s: 0.5.4, 0.6.1 (was: 0.5.4) > VertexGroup name should be unqiue > -

[jira] [Comment Edited] (TEZ-2256) Avoid use of BufferTooSmallException to signal end of buffer in UnorderedPartitionedKVWriter

2015-04-29 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14510581#comment-14510581 ] Rajesh Balamohan edited comment on TEZ-2256 at 4/29/15 11:23 PM: -

[jira] [Updated] (TEZ-2383) release sort buffers on close

2015-04-29 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-2383: -- Attachment: TEZ-2383.4.patch Addressing review comments. Added same for input/output contexts. >

[jira] [Updated] (TEZ-2391) TestVertexImpl timing out at times on jenkins builds

2015-04-29 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-2391: - Attachment: TestVertexImpl-output.txt >From build 1028, verteximpl test output. Probably timing out in the

[jira] [Created] (TEZ-2391) TestVertexImpl timing out at times on jenkins builds

2015-04-29 Thread Hitesh Shah (JIRA)
Hitesh Shah created TEZ-2391: Summary: TestVertexImpl timing out at times on jenkins builds Key: TEZ-2391 URL: https://issues.apache.org/jira/browse/TEZ-2391 Project: Apache Tez Issue Type: Bug

[jira] [Commented] (TEZ-2198) Fix sorter spill counts

2015-04-29 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520391#comment-14520391 ] Siddharth Seth commented on TEZ-2198: - Mostly looks good to me. Obligatory rename reques

[jira] [Commented] (TEZ-2390) tez-tools swimlane tool fails to parse large jobs >8K containers

2015-04-29 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520362#comment-14520362 ] TezQA commented on TEZ-2390: {color:red}-1 overall{color}. Here are the results of testing the

Failed: TEZ-2390 PreCommit Build #582

2015-04-29 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-2390 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/582/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated

[jira] [Commented] (TEZ-1560) Invalid state machine handling for V_SOURCE_VERTEX_RECOVERED in recovery

2015-04-29 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520352#comment-14520352 ] Hitesh Shah commented on TEZ-1560: -- Committed to master and branch 0.6. Hit a conflict on

[jira] [Updated] (TEZ-1560) Invalid state machine handling for V_SOURCE_VERTEX_RECOVERED in recovery

2015-04-29 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1560: - Summary: Invalid state machine handling for V_SOURCE_VERTEX_RECOVERED in recovery (was: Invalid state machi

[jira] [Commented] (TEZ-1560) Invalid state machine transition in recovery

2015-04-29 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520330#comment-14520330 ] Hitesh Shah commented on TEZ-1560: -- +1. Committing shortly. > Invalid state machine trans

[jira] [Updated] (TEZ-1560) Invalid state machine transition in recovery

2015-04-29 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-1560: - Target Version/s: 0.7.0, 0.5.4, 0.6.1 (was: 0.7.0) > Invalid state machine transition in recovery > ---

[jira] [Commented] (TEZ-2380) Disable fall back to reading from timeline if timeline disabled

2015-04-29 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520316#comment-14520316 ] Hitesh Shah commented on TEZ-2380: -- Committing shortly. TEZ-2385 just committed. > Disabl

[jira] [Resolved] (TEZ-2385) branch-0.6 compile failure caused by TEZ-2226

2015-04-29 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah resolved TEZ-2385. -- Resolution: Fixed Fix Version/s: 0.6.1 Committed to branch 0.6 > branch-0.6 compile failure cause

[jira] [Commented] (TEZ-2385) branch-0.6 compile failure caused by TEZ-2226

2015-04-29 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520313#comment-14520313 ] Hitesh Shah commented on TEZ-2385: -- Thanks [~jeagles] for the review. Committing shortly.

[jira] [Updated] (TEZ-2385) branch-0.6 compile failure caused by TEZ-2226

2015-04-29 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-2385: - Summary: branch-0.6 compile failure caused by TEZ-2226 (was: branch-0.6 compile failure) > branch-0.6 comp

[jira] [Commented] (TEZ-2385) branch-0.6 compile failure

2015-04-29 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520281#comment-14520281 ] Jonathan Eagles commented on TEZ-2385: -- +1. looks good, [~hitesh]. This is the correct

[jira] [Commented] (TEZ-2383) release sort buffers on close

2015-04-29 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520280#comment-14520280 ] Siddharth Seth commented on TEZ-2383: - The patch looks good. The intent is to allow GC o

[jira] [Commented] (TEZ-2366) Pig tez MiniTezCluster unit tests fail intermittently after TEZ-2333

2015-04-29 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520264#comment-14520264 ] Siddharth Seth commented on TEZ-2366: - Shuffle port should be sufficient though, right ?

[jira] [Commented] (TEZ-2385) branch-0.6 compile failure

2015-04-29 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520263#comment-14520263 ] Hitesh Shah commented on TEZ-2385: -- Thanks [~lichangleo]. \cc [~jeagles] for review. > br

[jira] [Commented] (TEZ-2348) EOF exception during UnorderedKVReader.next()

2015-04-29 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520244#comment-14520244 ] Hitesh Shah commented on TEZ-2348: -- bq. A terrible option would be to have the behaviour co

[jira] [Commented] (TEZ-2390) tez-tools swimlane tool fails to parse large jobs >8K containers

2015-04-29 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520240#comment-14520240 ] Jonathan Eagles commented on TEZ-2390: -- Cleanup the python warnings and better of parsi

[jira] [Updated] (TEZ-2390) tez-tools swimlane tool fails to parse large jobs >8K containers

2015-04-29 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-2390: - Attachment: TEZ-2390.1.patch > tez-tools swimlane tool fails to parse large jobs >8K containers > --

[jira] [Resolved] (TEZ-2382) Publish counters to timeline for failed/killed attempts

2015-04-29 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah resolved TEZ-2382. -- Resolution: Cannot Reproduce Counters are already published to ats for failed attempts. Aggregation at the

[jira] [Created] (TEZ-2390) tez-tools swimlane tool fails to parse large jobs >8K containers

2015-04-29 Thread Jonathan Eagles (JIRA)
Jonathan Eagles created TEZ-2390: Summary: tez-tools swimlane tool fails to parse large jobs >8K containers Key: TEZ-2390 URL: https://issues.apache.org/jira/browse/TEZ-2390 Project: Apache Tez

[jira] [Commented] (TEZ-776) Reduce AM mem usage caused by storing TezEvents

2015-04-29 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520228#comment-14520228 ] Bikas Saha commented on TEZ-776: bq. In Edge, "routeInputSourceTaskFailedEventToDestination"

[jira] [Commented] (TEZ-2348) EOF exception during UnorderedKVReader.next()

2015-04-29 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520212#comment-14520212 ] Siddharth Seth commented on TEZ-2348: - [~gopalv] - I see the point of throwing an except

Failed: TEZ-2389 PreCommit Build #581

2015-04-29 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-2389 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/581/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated

[jira] [Commented] (TEZ-2389) Tez UI: Sort by attempt-no is incorrect in attempts pages.

2015-04-29 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520171#comment-14520171 ] TezQA commented on TEZ-2389: {color:red}-1 overall{color}. Here are the results of testing the

[jira] [Commented] (TEZ-2360) per-io counters flag should generate both overall and per-edge counters

2015-04-29 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520160#comment-14520160 ] Siddharth Seth commented on TEZ-2360: - Nothing else to add. Looks good, after Bikas' com

[jira] [Commented] (TEZ-2360) per-io counters flag should generate both overall and per-edge counters

2015-04-29 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520133#comment-14520133 ] Bikas Saha commented on TEZ-2360: - More descriptive names than counter1 and counter2 would b

[jira] [Commented] (TEZ-2366) Pig tez MiniTezCluster unit tests fail intermittently after TEZ-2333

2015-04-29 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520111#comment-14520111 ] Hitesh Shah commented on TEZ-2366: -- Maybe an initial fix would be to just disable this for

[jira] [Commented] (TEZ-2366) Pig tez MiniTezCluster unit tests fail intermittently after TEZ-2333

2015-04-29 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520082#comment-14520082 ] Siddharth Seth commented on TEZ-2366: - Relying on the shuffle port from config won't wor

[jira] [Commented] (TEZ-2385) branch-0.6 compile failure

2015-04-29 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520077#comment-14520077 ] Chang Li commented on TEZ-2385: --- [~hitesh], thanks for the patch, it's a nice fix. Have tested

[jira] [Updated] (TEZ-2385) branch-0.6 compile failure

2015-04-29 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated TEZ-2385: - Attachment: TEZ-2385.1.patch [~pramachandran] [~zjffdu] [~lichangleo] Please review. > branch-0.6 compile

[jira] [Updated] (TEZ-2389) Tez UI: Sort by attempt-no is incorrect in attempts pages.

2015-04-29 Thread Sreenath Somarajapuram (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sreenath Somarajapuram updated TEZ-2389: Attachment: TEZ-2389.1.patch Cause: Getter to return the value to be sorted was missin

[jira] [Assigned] (TEZ-2389) Tez UI: Sort by attempt-no is incorrect in attempts pages.

2015-04-29 Thread Sreenath Somarajapuram (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sreenath Somarajapuram reassigned TEZ-2389: --- Assignee: Sreenath Somarajapuram > Tez UI: Sort by attempt-no is incorrect in a

[jira] [Created] (TEZ-2389) Tez UI: Sort by attempt-no is incorrect in attempts pages.

2015-04-29 Thread Sreenath Somarajapuram (JIRA)
Sreenath Somarajapuram created TEZ-2389: --- Summary: Tez UI: Sort by attempt-no is incorrect in attempts pages. Key: TEZ-2389 URL: https://issues.apache.org/jira/browse/TEZ-2389 Project: Apache Tez

[jira] [Commented] (TEZ-2084) Tez UI: Stacktrace format info is lost in diagnostics

2015-04-29 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14519881#comment-14519881 ] TezQA commented on TEZ-2084: {color:red}-1 overall{color}. Here are the results of testing the

Failed: TEZ-2084 PreCommit Build #580

2015-04-29 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-2084 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/580/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated

[jira] [Commented] (TEZ-2380) Disable fall back to reading from timeline if timeline disabled

2015-04-29 Thread Prakash Ramachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14519877#comment-14519877 ] Prakash Ramachandran commented on TEZ-2380: --- [~lichangleo] will wait for the 0.6.1

[jira] [Commented] (TEZ-2378) In case Fetcher (unordered) fails to do local fetch, log in debug mode to reduce log size

2015-04-29 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14519864#comment-14519864 ] Hitesh Shah commented on TEZ-2378: -- bq. These are normal exceptions when fetcher is unable

[jira] [Updated] (TEZ-2084) Tez UI: Stacktrace format info is lost in diagnostics

2015-04-29 Thread Prakash Ramachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prakash Ramachandran updated TEZ-2084: -- Attachment: TEZ-2084.2.patch > Tez UI: Stacktrace format info is lost in diagnostics > ---

[jira] [Commented] (TEZ-2084) Tez UI: Stacktrace format info is lost in diagnostics

2015-04-29 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14519803#comment-14519803 ] TezQA commented on TEZ-2084: {color:red}-1 overall{color}. Here are the results of testing the

Failed: TEZ-2084 PreCommit Build #579

2015-04-29 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-2084 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/579/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated

[jira] [Updated] (TEZ-2084) Tez UI: Stacktrace format info is lost in diagnostics

2015-04-29 Thread Prakash Ramachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prakash Ramachandran updated TEZ-2084: -- Summary: Tez UI: Stacktrace format info is lost in diagnostics (was: TEZ-UI Stacktrace fo

[jira] [Commented] (TEZ-2084) TEZ-UI Stacktrace format info is lost in diagnostics

2015-04-29 Thread Prakash Ramachandran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14519676#comment-14519676 ] Prakash Ramachandran commented on TEZ-2084: --- [~jeagles] should this be checked int

[jira] [Commented] (TEZ-2386) Tez UI: Inconsistent usage of icon colors

2015-04-29 Thread TezQA (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14519598#comment-14519598 ] TezQA commented on TEZ-2386: {color:green}+1 overall{color}. Here are the results of testing th

Success: TEZ-2386 PreCommit Build #578

2015-04-29 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/TEZ-2386 Build: https://builds.apache.org/job/PreCommit-TEZ-Build/578/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated

[jira] [Commented] (TEZ-1529) ATS and TezClient integration in secure kerberos enabled cluster

2015-04-29 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14519545#comment-14519545 ] Steve Loughran commented on TEZ-1529: - oh, this is exactly what I'm looking for. I've be

[jira] [Resolved] (TEZ-2388) Send dag identifier as part of the fetcher request string

2015-04-29 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth resolved TEZ-2388. - Resolution: Fixed Fix Version/s: TEZ-2003 > Send dag identifier as part of the fetcher reques

[jira] [Updated] (TEZ-2388) Send dag identifier as part of the fetcher request string

2015-04-29 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated TEZ-2388: Attachment: TEZ-2388.1.txt > Send dag identifier as part of the fetcher request string > -

[jira] [Created] (TEZ-2388) Send dag identifier as part of the fetcher request string

2015-04-29 Thread Siddharth Seth (JIRA)
Siddharth Seth created TEZ-2388: --- Summary: Send dag identifier as part of the fetcher request string Key: TEZ-2388 URL: https://issues.apache.org/jira/browse/TEZ-2388 Project: Apache Tez Issue

  1   2   >