[jira] [Commented] (TEZ-3650) Improve performance of FetchStatsLogger#logIndividualFetchComplete

2017-03-11 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15906189#comment-15906189 ] Rajesh Balamohan commented on TEZ-3650: --- [~jeagles] - sorry about the delay. Will chec

[jira] [Created] (TEZ-3658) building tez-ui throws exceptions

2017-03-11 Thread Rajesh Balamohan (JIRA)
Rajesh Balamohan created TEZ-3658: - Summary: building tez-ui throws exceptions Key: TEZ-3658 URL: https://issues.apache.org/jira/browse/TEZ-3658 Project: Apache Tez Issue Type: Bug

[jira] [Commented] (TEZ-3648) IFile.Write#close has an extra output stream flush

2017-03-06 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15897294#comment-15897294 ] Rajesh Balamohan commented on TEZ-3648: --- Thanks for the patch [~jeagles]. Patch lgtm.

[jira] [Comment Edited] (TEZ-3649) AsyncHttpConnection should add StopWatch start

2017-03-05 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15896660#comment-15896660 ] Rajesh Balamohan edited comment on TEZ-3649 at 3/6/17 2:43 AM: ---

[jira] [Comment Edited] (TEZ-3649) AsyncHttpConnection should add StopWatch start

2017-03-05 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15896660#comment-15896660 ] Rajesh Balamohan edited comment on TEZ-3649 at 3/6/17 2:42 AM: ---

[jira] [Commented] (TEZ-3649) AsyncHttpConnection should add StopWatch start

2017-03-05 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15896660#comment-15896660 ] Rajesh Balamohan commented on TEZ-3649: --- Thanks for the patch [~ferhui]. Patch lgtm. W

[jira] [Commented] (TEZ-3644) Cleanup container list stored in AMNode

2017-03-02 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15893203#comment-15893203 ] Rajesh Balamohan commented on TEZ-3644: --- lgtm. +1. Please cleanup imports in {{TestAMC

[jira] [Commented] (TEZ-3646) IFile.Writer has an extra output stream flush call

2017-03-02 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15892445#comment-15892445 ] Rajesh Balamohan commented on TEZ-3646: --- Thanks for sharing the patch [~jeagles]. Patc

[jira] [Commented] (TEZ-3643) Long running AMs can go out of memory due to retained AMContainer instances

2017-03-01 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15891233#comment-15891233 ] Rajesh Balamohan commented on TEZ-3643: --- Thanks for the details [~sseth]. We can revis

[jira] [Commented] (TEZ-3643) Long running AMs can go out of memory due to retained AMContainer instances

2017-03-01 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15889792#comment-15889792 ] Rajesh Balamohan commented on TEZ-3643: --- lgtm. +1. Should we fix it till 0.7?. > Long

[jira] [Commented] (TEZ-3637) TezMerger logs too much on INFO level

2017-02-27 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15887135#comment-15887135 ] Rajesh Balamohan commented on TEZ-3637: --- lgtm. +1. > TezMerger logs too much on INFO

[jira] [Commented] (TEZ-3638) VertexImpl logs too much at info when removing tasks after auto-reduce parallelism

2017-02-27 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15886628#comment-15886628 ] Rajesh Balamohan commented on TEZ-3638: --- Patch lgtm. +1. > VertexImpl logs too much a

[jira] [Comment Edited] (TEZ-3633) Implement keep-alive timeout in tez shuffle handler

2017-02-26 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15884986#comment-15884986 ] Rajesh Balamohan edited comment on TEZ-3633 at 2/27/17 2:16 AM: --

[jira] [Commented] (TEZ-3633) Implement keep-alive timeout in tez shuffle handler

2017-02-26 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15884986#comment-15884986 ] Rajesh Balamohan commented on TEZ-3633: --- Thanks for sharing the patch in MAPREDUCE-685

[jira] [Commented] (TEZ-3638) VertexImpl logs too much at info when removing tasks after auto-reduce parallelism

2017-02-24 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15884071#comment-15884071 ] Rajesh Balamohan commented on TEZ-3638: --- In that case we do not need to log additional

[jira] [Commented] (TEZ-3638) VertexImpl logs too much at info when removing tasks after auto-reduce parallelism

2017-02-24 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15884062#comment-15884062 ] Rajesh Balamohan commented on TEZ-3638: --- Current log line can be at debug level with {

[jira] [Commented] (TEZ-3637) TezMerger logs too much on INFO level

2017-02-24 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15882277#comment-15882277 ] Rajesh Balamohan commented on TEZ-3637: --- Can the stats size be 0 and lead to error dur

[jira] [Commented] (TEZ-3637) TezMerger logs too much on INFO level

2017-02-24 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15882175#comment-15882175 ] Rajesh Balamohan commented on TEZ-3637: --- lgtm. +1. Minor comment (lastInMemSegmentLogT

[jira] [Commented] (TEZ-3633) Implement keep-alive timeout in tez shuffle handler

2017-02-22 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15880006#comment-15880006 ] Rajesh Balamohan commented on TEZ-3633: --- Checked more on it. Channel was getting close

[jira] [Commented] (TEZ-3633) Implement keep-alive timeout in tez shuffle handler

2017-02-22 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15879994#comment-15879994 ] Rajesh Balamohan commented on TEZ-3633: --- I was able to reproduce the issue. Issue seem

[jira] [Updated] (TEZ-3633) Implement keep-alive timeout in tez shuffle handler

2017-02-22 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-3633: -- Attachment: with_hadoop_2.7.3.png > Implement keep-alive timeout in tez shuffle handler >

[jira] [Commented] (TEZ-3634) reduce the buffer sizes in PipelinedSorter by a small amount

2017-02-22 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15878502#comment-15878502 ] Rajesh Balamohan commented on TEZ-3634: --- test changes are fine. +1. Thanks [~sseth] >

[jira] [Commented] (TEZ-3633) Implement keep-alive timeout in tez shuffle handler

2017-02-22 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15878493#comment-15878493 ] Rajesh Balamohan commented on TEZ-3633: --- Thanks [~jeagles]. I will install tcpdump on

[jira] [Commented] (TEZ-3633) Implement keep-alive timeout in tez shuffle handler

2017-02-21 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15877526#comment-15877526 ] Rajesh Balamohan commented on TEZ-3633: --- I enabled keep-alive in tez and mapreduce sh

[jira] [Comment Edited] (TEZ-3633) Implement keep-alive timeout in tez shuffle handler

2017-02-21 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15877526#comment-15877526 ] Rajesh Balamohan edited comment on TEZ-3633 at 2/22/17 5:46 AM: --

[jira] [Commented] (TEZ-3634) reduce the buffer sizes in PipelinedSorter by a small amount

2017-02-21 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15877511#comment-15877511 ] Rajesh Balamohan commented on TEZ-3634: --- lgtm. +1. Pending tests. > reduce the buffer

[jira] [Commented] (TEZ-3633) Implement keep-alive timeout in tez shuffle handler

2017-02-21 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15876867#comment-15876867 ] Rajesh Balamohan commented on TEZ-3633: --- [~jeagles] - Is this for the custom shuffle h

[jira] [Commented] (TEZ-3624) Split multiple calls on the same line in TaskCommunicatorContextImpl

2017-02-14 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15867286#comment-15867286 ] Rajesh Balamohan commented on TEZ-3624: --- +1. lgtm. Minor comment: Should this be adde

[jira] [Commented] (TEZ-3625) Dag.getVertex should obtain a readlock

2017-02-14 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15866921#comment-15866921 ] Rajesh Balamohan commented on TEZ-3625: --- lgtm. +1 > Dag.getVertex should obtain a rea

[jira] [Commented] (TEZ-3550) DagClient does not provide access to AppID/DagID

2017-02-12 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15863136#comment-15863136 ] Rajesh Balamohan commented on TEZ-3550: --- lgtm. +1. Pending jenkin tests. > DagClient

[jira] [Commented] (TEZ-3589) add a unit test for amKeepAlive not being shutdown if an app takes a long time to launch

2017-01-26 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15840609#comment-15840609 ] Rajesh Balamohan commented on TEZ-3589: --- LGTM. +1 > add a unit test for amKeepAlive n

[jira] [Updated] (TEZ-3582) Exception swallowed in PipelinedSorter causing incorrect results

2017-01-24 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-3582: -- Attachment: TEZ-3582.2.patch Thanks [~gopalv]. Attaching .2 patch. > Exception swallowed in Pipel

[jira] [Commented] (TEZ-3582) Exception swallowed in PipelinedSorter causing incorrect results

2017-01-19 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15830765#comment-15830765 ] Rajesh Balamohan commented on TEZ-3582: --- Thanks for sharing the details [~tmwoodruff].

[jira] [Commented] (TEZ-3582) Exception swallowed in PipelinedSorter causing incorrect results

2017-01-19 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15830734#comment-15830734 ] Rajesh Balamohan commented on TEZ-3582: --- {noformat} Caused by: java.io.EOFException

[jira] [Updated] (TEZ-3582) Exception swallowed in PipelinedSorter causing incorrect results

2017-01-18 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-3582: -- Attachment: TEZ-3582.debug.patch Attaching debug patch. [~tmwoodruff] - Can you please try with th

[jira] [Commented] (TEZ-3579) Wrong configuration key for max slow start fraction in CartesianProductVertexManager

2017-01-17 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15827139#comment-15827139 ] Rajesh Balamohan commented on TEZ-3579: --- +1 > Wrong configuration key for max slow st

[jira] [Commented] (TEZ-3569) Improve buffer handling in PipelinedSorter after encountering initial spill condition

2017-01-17 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15825666#comment-15825666 ] Rajesh Balamohan commented on TEZ-3569: --- Cancelled the patch as I encountered the foll

[jira] [Updated] (TEZ-3551) FrameworkClient created twice causing minor delay

2017-01-09 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-3551: -- Attachment: TEZ-3551.6.patch Thanks [~sseth]. Made isRunning as volatile and addressed the comment

[jira] [Updated] (TEZ-3551) FrameworkClient created twice causing minor delay

2017-01-09 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-3551: -- Attachment: TEZ-3551.5.patch > FrameworkClient created twice causing minor delay > --

[jira] [Commented] (TEZ-3551) FrameworkClient created twice causing minor delay

2017-01-09 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15811613#comment-15811613 ] Rajesh Balamohan commented on TEZ-3551: --- Thanks [~sseth]. Attaching revised patch, wh

[jira] [Updated] (TEZ-3551) FrameworkClient created twice causing minor delay

2017-01-09 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-3551: -- Attachment: TEZ-3551.4.patch > FrameworkClient created twice causing minor delay > --

[jira] [Updated] (TEZ-3569) Improve buffer handling in PipelinedSorter after encountering initial spill condition

2017-01-05 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-3569: -- Attachment: TEZ-3569.1.patch > Improve buffer handling in PipelinedSorter after encountering initi

[jira] [Comment Edited] (TEZ-3551) FrameworkClient created twice causing minor delay

2017-01-04 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15721728#comment-15721728 ] Rajesh Balamohan edited comment on TEZ-3551 at 1/5/17 6:12 AM: ---

[jira] [Created] (TEZ-3569) Improve buffer handling in PipelinedSorter after encountering initial spill condition

2017-01-04 Thread Rajesh Balamohan (JIRA)
Rajesh Balamohan created TEZ-3569: - Summary: Improve buffer handling in PipelinedSorter after encountering initial spill condition Key: TEZ-3569 URL: https://issues.apache.org/jira/browse/TEZ-3569 Pro

[jira] [Commented] (TEZ-3555) Tez UI: Build is failing in RHEL6

2017-01-03 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15797324#comment-15797324 ] Rajesh Balamohan commented on TEZ-3555: --- +1. Without patch it was throwing exceptions.

[jira] [Commented] (TEZ-3555) Tez UI: Build is failing in RHEL6

2017-01-03 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15794893#comment-15794893 ] Rajesh Balamohan commented on TEZ-3555: --- tried on centos 6.6. It worked fine without

[jira] [Commented] (TEZ-3565) amConfig should check queuename isEmpty

2016-12-20 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15763611#comment-15763611 ] Rajesh Balamohan commented on TEZ-3565: --- Thanks [~ferhui]. +1. Will commit shortly.

[jira] [Commented] (TEZ-3551) FrameworkClient created twice causing minor delay

2016-12-08 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15731487#comment-15731487 ] Rajesh Balamohan commented on TEZ-3551: --- Had offline discussion with [~aplusplus]. Th

[jira] [Commented] (TEZ-3551) FrameworkClient created twice causing minor delay

2016-12-07 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15730726#comment-15730726 ] Rajesh Balamohan commented on TEZ-3551: --- Cancelled the patch as one more corner case n

[jira] [Updated] (TEZ-3551) FrameworkClient created twice causing minor delay

2016-12-07 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-3551: -- Attachment: TEZ-3551.3.patch Thanks [~aplusplus]. Attaching .3 with review comments addressed. >

[jira] [Updated] (TEZ-3551) FrameworkClient created twice causing minor delay

2016-12-05 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-3551: -- Attachment: TEZ-3551.sameas.2.patch > FrameworkClient created twice causing minor delay > ---

[jira] [Comment Edited] (TEZ-3551) FrameworkClient created twice causing minor delay

2016-12-05 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15721728#comment-15721728 ] Rajesh Balamohan edited comment on TEZ-3551 at 12/5/16 9:38 AM: --

[jira] [Updated] (TEZ-3551) FrameworkClient created twice causing minor delay

2016-12-05 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-3551: -- Attachment: test_result.txt > FrameworkClient created twice causing minor delay > ---

[jira] [Updated] (TEZ-3551) FrameworkClient created twice causing minor delay

2016-12-05 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-3551: -- Attachment: TEZ-3551.2.patch FrameworkClient stop() can be removed in close call, so that it does

[jira] [Updated] (TEZ-3551) FrameworkClient created twice causing minor delay

2016-11-30 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-3551: -- Attachment: TEZ-3551.1.patch > FrameworkClient created twice causing minor delay > --

[jira] [Assigned] (TEZ-3551) FrameworkClient created twice causing minor delay

2016-11-30 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan reassigned TEZ-3551: - Assignee: Rajesh Balamohan > FrameworkClient created twice causing minor delay > -

[jira] [Created] (TEZ-3551) FrameworkClient created twice causing minor delay

2016-11-29 Thread Rajesh Balamohan (JIRA)
Rajesh Balamohan created TEZ-3551: - Summary: FrameworkClient created twice causing minor delay Key: TEZ-3551 URL: https://issues.apache.org/jira/browse/TEZ-3551 Project: Apache Tez Issue Typ

[jira] [Commented] (TEZ-3547) Add TaskAssignment Analyzer

2016-11-28 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15703559#comment-15703559 ] Rajesh Balamohan commented on TEZ-3547: --- +1 on latest patch. Thanks [~dharmesh.kakadia

[jira] [Commented] (TEZ-3547) Add TaskAssignment Analyzer

2016-11-23 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15691923#comment-15691923 ] Rajesh Balamohan commented on TEZ-3547: --- Thanks [~dharmesh.kakadia]. Minor comments.

[jira] [Commented] (TEZ-3547) Add TaskAssignment Analyzer

2016-11-22 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15688782#comment-15688782 ] Rajesh Balamohan commented on TEZ-3547: --- Thanks for sharing patch [~dharmesh.kakadia].

[jira] [Commented] (TEZ-3212) IFile throws NegativeArraySizeException for value sizes between 1GB and 2GB

2016-11-20 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15682025#comment-15682025 ] Rajesh Balamohan commented on TEZ-3212: --- Even for a key/value size 1.3 GB, it would ha

[jira] [Commented] (TEZ-3534) Differentiate thread names on Fetchers, minor changes to shuffle shutdown code

2016-11-09 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15652624#comment-15652624 ] Rajesh Balamohan commented on TEZ-3534: --- Minor: plz fix {{Failed log prgress while clo

[jira] [Updated] (TEZ-3533) ShuffleScheduler should shutdown threadpool on exit

2016-11-08 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-3533: -- Target Version/s: 0.9.0, 0.8.5 Fix Version/s: 0.8.5 > ShuffleScheduler should shutdown thre

[jira] [Commented] (TEZ-3533) ShuffleScheduler should shutdown threadpool on exit

2016-11-08 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15649566#comment-15649566 ] Rajesh Balamohan commented on TEZ-3533: --- Committed to master and branch-0.8 >>> maste

[jira] [Commented] (TEZ-3533) ShuffleScheduler should shutdown threadpool on exit

2016-11-08 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15649534#comment-15649534 ] Rajesh Balamohan commented on TEZ-3533: --- Test failure is unrelated to this patch. >

[jira] [Updated] (TEZ-3533) ShuffleScheduler should shutdown threadpool on exit

2016-11-08 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-3533: -- Attachment: TEZ-3533.1.patch [~sseth] - Can you please review when you find time? > ShuffleSchedu

[jira] [Created] (TEZ-3533) ShuffleScheduler should shutdown threadpool on exit

2016-11-08 Thread Rajesh Balamohan (JIRA)
Rajesh Balamohan created TEZ-3533: - Summary: ShuffleScheduler should shutdown threadpool on exit Key: TEZ-3533 URL: https://issues.apache.org/jira/browse/TEZ-3533 Project: Apache Tez Issue Ty

[jira] [Created] (TEZ-3481) MergeManager should cleanup the data on exit

2016-10-20 Thread Rajesh Balamohan (JIRA)
Rajesh Balamohan created TEZ-3481: - Summary: MergeManager should cleanup the data on exit Key: TEZ-3481 URL: https://issues.apache.org/jira/browse/TEZ-3481 Project: Apache Tez Issue Type: Imp

[jira] [Updated] (TEZ-3478) Cleanup fetcher data for failing task attempts (Unordered fetcher)

2016-10-19 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-3478: -- Attachment: TEZ-3479.1.patch attaching master branch .1 patch. \cc [~sseth] > Cleanup fetcher da

[jira] [Updated] (TEZ-3478) Cleanup fetcher data for failing task attempts (Unordered fetcher)

2016-10-19 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-3478: -- Attachment: TEZ-3479.branch-0.7.001.patch Attaching .1 version of the patch based on 0.7 for initi

[jira] [Commented] (TEZ-3479) DAG AM does not schedule any more containers in corner cases

2016-10-18 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15587501#comment-15587501 ] Rajesh Balamohan commented on TEZ-3479: --- That is correct. Haven't observed this in oth

[jira] [Commented] (TEZ-3479) DAG AM does not schedule any more containers in corner cases

2016-10-18 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15586998#comment-15586998 ] Rajesh Balamohan commented on TEZ-3479: --- [~hitesh] - I haven't disabled recovery in my

[jira] [Commented] (TEZ-3478) Cleanup fetcher data for failing task attempts (Unordered fetcher)

2016-10-18 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15586993#comment-15586993 ] Rajesh Balamohan commented on TEZ-3478: --- Haven't checked for ordered case yet, but sho

[jira] [Updated] (TEZ-3479) DAG AM does not schedule any more containers in corner cases

2016-10-18 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-3479: -- Attachment: application_1476667862449_0031_not_complete.1.log.tar.gz > DAG AM does not schedule an

[jira] [Updated] (TEZ-3479) DAG AM does not schedule any more containers in corner cases

2016-10-18 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-3479: -- Affects Version/s: 0.7.1 > DAG AM does not schedule any more containers in corner cases >

[jira] [Created] (TEZ-3479) DAG AM does not schedule any more containers in corner cases

2016-10-18 Thread Rajesh Balamohan (JIRA)
Rajesh Balamohan created TEZ-3479: - Summary: DAG AM does not schedule any more containers in corner cases Key: TEZ-3479 URL: https://issues.apache.org/jira/browse/TEZ-3479 Project: Apache Tez

[jira] [Created] (TEZ-3478) Cleanup fetcher data for failing task attempts (Unordered fetcher)

2016-10-18 Thread Rajesh Balamohan (JIRA)
Rajesh Balamohan created TEZ-3478: - Summary: Cleanup fetcher data for failing task attempts (Unordered fetcher) Key: TEZ-3478 URL: https://issues.apache.org/jira/browse/TEZ-3478 Project: Apache Tez

[jira] [Commented] (TEZ-3453) Correct the downloaded ATS dag data location for analyzer

2016-10-11 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15567093#comment-15567093 ] Rajesh Balamohan commented on TEZ-3453: --- Thank you for the contribution [~dharmesh.kak

[jira] [Commented] (TEZ-3453) Correct the downloaded ATS dag data location for analyzer

2016-10-11 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15565090#comment-15565090 ] Rajesh Balamohan commented on TEZ-3453: --- Thanks for the patch [~dharmesh.kakadia]. Pa

[jira] [Commented] (TEZ-2741) Hive on Tez does not work well with Sequence Files Schema changes

2016-09-29 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15534371#comment-15534371 ] Rajesh Balamohan commented on TEZ-2741: --- Key/Val references can not be updated at the

[jira] [Commented] (TEZ-3442) Flaky test: TestMapProcessor::testMapProcessorProgress

2016-09-21 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15511867#comment-15511867 ] Rajesh Balamohan commented on TEZ-3442: --- +1. Will commit after jenkin results are publ

[jira] [Commented] (TEZ-3163) Reuse and tune Inflaters and Deflaters to speed DME processing

2016-09-20 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15506002#comment-15506002 ] Rajesh Balamohan commented on TEZ-3163: --- [~jeagles] - Sorry about the delay. Patch L

[jira] [Commented] (TEZ-3317) Speculative execution starts too early due to 0 progress

2016-09-16 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15495712#comment-15495712 ] Rajesh Balamohan commented on TEZ-3317: --- No harm in porting to 0.7, but [~jeagles] wou

[jira] [Commented] (TEZ-3317) Speculative execution starts too early due to 0 progress

2016-09-13 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15488726#comment-15488726 ] Rajesh Balamohan commented on TEZ-3317: --- Latest patch LTGM. Thanks [~kshukla]. > Spe

[jira] [Commented] (TEZ-3317) Speculative execution starts too early due to 0 progress

2016-09-11 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15482821#comment-15482821 ] Rajesh Balamohan commented on TEZ-3317: --- Sorry about the delay. Minor comments - In Or

[jira] [Commented] (TEZ-3284) Synchronization for every write in UnorderdKVWriter

2016-09-07 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15472059#comment-15472059 ] Rajesh Balamohan commented on TEZ-3284: --- lgtm. +1. Very minor comment. MultipleCommit

[jira] [Commented] (TEZ-2741) Hive on Tez does not work well with Sequence Files Schema changes

2016-09-01 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15456304#comment-15456304 ] Rajesh Balamohan commented on TEZ-2741: --- Thanks for reverting the patch [~hitesh]. The

[jira] [Comment Edited] (TEZ-3317) Speculative execution starts too early due to 0 progress

2016-08-26 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15438516#comment-15438516 ] Rajesh Balamohan edited comment on TEZ-3317 at 8/26/16 9:06 AM: --

[jira] [Commented] (TEZ-3317) Speculative execution starts too early due to 0 progress

2016-08-25 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15438516#comment-15438516 ] Rajesh Balamohan commented on TEZ-3317: --- Thanks for sharing the patch. I tried with co

[jira] [Commented] (TEZ-3197) Tez-tools: create zeppelin notebook for tez analyzers

2016-08-24 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15435995#comment-15435995 ] Rajesh Balamohan commented on TEZ-3197: --- [~hitesh] - We can add the notebook (json) in

[jira] [Commented] (TEZ-2741) Hive on Tez does not work well with Sequence Files Schema changes

2016-08-17 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-2741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15425645#comment-15425645 ] Rajesh Balamohan commented on TEZ-2741: --- I haven't been able to test it with Pig+Hive

[jira] [Commented] (TEZ-3403) Empty partition issue with Hive on TEZ

2016-08-10 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15416607#comment-15416607 ] Rajesh Balamohan commented on TEZ-3403: --- That is strange, given that the exception is

[jira] [Commented] (TEZ-3403) Empty partition issue with Hive on TEZ

2016-08-10 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15416181#comment-15416181 ] Rajesh Balamohan commented on TEZ-3403: --- [~ashu_bhumca] - Looks like you are accessing

[jira] [Commented] (TEZ-3382) Tez analyzer: Should be resilient to new counters

2016-07-28 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15397154#comment-15397154 ] Rajesh Balamohan commented on TEZ-3382: --- Pasting jenkin's output. Will commit shortly.

[jira] [Updated] (TEZ-3382) Tez analyzer: Should be resilient to new counters

2016-07-27 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-3382: -- Attachment: TEZ-3382.1.patch [~hitesh] - Can you please review when you find time? > Tez analyzer

[jira] [Assigned] (TEZ-3382) Tez analyzer: Should be resilient to new counters

2016-07-27 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan reassigned TEZ-3382: - Assignee: Rajesh Balamohan > Tez analyzer: Should be resilient to new counters > --

[jira] [Created] (TEZ-3382) Tez analyzer: Should be resilient to new counters

2016-07-27 Thread Rajesh Balamohan (JIRA)
Rajesh Balamohan created TEZ-3382: - Summary: Tez analyzer: Should be resilient to new counters Key: TEZ-3382 URL: https://issues.apache.org/jira/browse/TEZ-3382 Project: Apache Tez Issue Type

[jira] [Commented] (TEZ-3379) Tez analyzer: Move sysout to log4j

2016-07-27 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15396520#comment-15396520 ] Rajesh Balamohan commented on TEZ-3379: --- Thanks [~hitesh] Some issue with jenkins in

[jira] [Updated] (TEZ-3379) Tez analyzer: Move sysout to log4j

2016-07-27 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-3379: -- Attachment: TEZ-3379.2.patch Thanks [~hitesh] and [~zjffdu]. Attaching .2 (moved some of the logs

[jira] [Updated] (TEZ-3379) Tez analyzer: Move sysout to log4j

2016-07-26 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/TEZ-3379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-3379: -- Attachment: TEZ-3379.1.patch > Tez analyzer: Move sysout to log4j > --

<    1   2   3   4   5   6   7   8   9   10   >