[jira] [Assigned] (TEZ-2833) Dont create extra directory during ATS file download

[ https://issues.apache.org/jira/browse/TEZ-2833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan reassigned TEZ-2833: - Assignee: Rajesh Balamohan > Dont create extra directory during ATS file download > ---

[jira] [Updated] (TEZ-2827) Increase timeout for TestFetcher testInputAttemptIdentifierMap

[ https://issues.apache.org/jira/browse/TEZ-2827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-2827: -- Attachment: TEZ-2827.1.patch [~pramachandran] - Can you plz review? > Increase timeout for TestFe

[jira] [Created] (TEZ-2827) Increase timeout for TestFetcher testInputAttemptIdentifierMap

Rajesh Balamohan created TEZ-2827: - Summary: Increase timeout for TestFetcher testInputAttemptIdentifierMap Key: TEZ-2827 URL: https://issues.apache.org/jira/browse/TEZ-2827 Project: Apache Tez

[jira] [Comment Edited] (TEZ-2825) Report progress in terms of completed tasks to reduce load on AM for Tez UI

[ https://issues.apache.org/jira/browse/TEZ-2825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14745202#comment-14745202 ] Rajesh Balamohan edited comment on TEZ-2825 at 9/15/15 10:23 AM: -

[jira] [Commented] (TEZ-2825) Report progress in terms of completed tasks to reduce load on AM for Tez UI

[ https://issues.apache.org/jira/browse/TEZ-2825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14745202#comment-14745202 ] Rajesh Balamohan commented on TEZ-2825: --- >>> Running org.apache.tez.dag.app.web.TestAM

[jira] [Comment Edited] (TEZ-2825) Report progress in terms of completed tasks to reduce load on AM for Tez UI

[ https://issues.apache.org/jira/browse/TEZ-2825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14745202#comment-14745202 ] Rajesh Balamohan edited comment on TEZ-2825 at 9/15/15 10:22 AM: -

[jira] [Updated] (TEZ-2825) Report progress in terms of completed tasks to reduce load on AM for Tez UI

[ https://issues.apache.org/jira/browse/TEZ-2825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-2825: -- Attachment: TEZ-2825.4.patch > Report progress in terms of completed tasks to reduce load on AM fo

[jira] [Updated] (TEZ-2825) Report progress in terms of completed tasks to reduce load on AM for Tez UI

[ https://issues.apache.org/jira/browse/TEZ-2825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-2825: -- Attachment: TEZ-2825.3.patch Minor revision which avoids nested readlock in DAGImpl and VertexImpl

[jira] [Commented] (TEZ-2825) Report progress in terms of completed tasks to reduce load on AM for Tez UI

[ https://issues.apache.org/jira/browse/TEZ-2825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14744958#comment-14744958 ] Rajesh Balamohan commented on TEZ-2825: --- +1. very minor comment inTerminalState() che

[jira] [Created] (TEZ-2811) Tez history parser: VertexInfo.getTaskAttemptsInternal() can be expensive

Rajesh Balamohan created TEZ-2811: - Summary: Tez history parser: VertexInfo.getTaskAttemptsInternal() can be expensive Key: TEZ-2811 URL: https://issues.apache.org/jira/browse/TEZ-2811 Project: Apache

[jira] [Commented] (TEZ-2810) Support for showing allocation delays due to internal preemption

[ https://issues.apache.org/jira/browse/TEZ-2810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14740434#comment-14740434 ] Rajesh Balamohan commented on TEZ-2810: --- Minor comments - VertexInfo.getTaskAttemptsI

[jira] [Commented] (TEZ-2807) Log data in the finish event instead of the start event

[ https://issues.apache.org/jira/browse/TEZ-2807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14739839#comment-14739839 ] Rajesh Balamohan commented on TEZ-2807: --- lgtm. +1. > Log data in the finish event ins

[jira] [Updated] (TEZ-2799) SimpleHistoryParser NPE

[ https://issues.apache.org/jira/browse/TEZ-2799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-2799: -- Target Version/s: 0.8.1 > SimpleHistoryParser NPE > --- > > Ke

[jira] [Updated] (TEZ-2799) SimpleHistoryParser NPE

[ https://issues.apache.org/jira/browse/TEZ-2799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-2799: -- Attachment: TEZ-2799.2.patch > SimpleHistoryParser NPE > --- > >

[jira] [Updated] (TEZ-2784) optimize TaskImpl.isFinished()

[ https://issues.apache.org/jira/browse/TEZ-2784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-2784: -- Target Version/s: 0.7.1 (was: 0.8.1) > optimize TaskImpl.isFinished() > -

[jira] [Commented] (TEZ-2775) Reduce logging in runtime components

[ https://issues.apache.org/jira/browse/TEZ-2775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14738508#comment-14738508 ] Rajesh Balamohan commented on TEZ-2775: --- Fetcher/FetcherOrderedGrouped - should we ret

[jira] [Updated] (TEZ-2799) SimpleHistoryParser NPE

[ https://issues.apache.org/jira/browse/TEZ-2799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-2799: -- Attachment: TEZ-2799.1.patch [~bikassaha] - This happens in scenario where the container details a

[jira] [Updated] (TEZ-2798) NPE when executing TestMemoryWithEvents::testMemoryScatterGather

[ https://issues.apache.org/jira/browse/TEZ-2798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-2798: -- Target Version/s: 0.8.1 > NPE when executing TestMemoryWithEvents::testMemoryScatterGather > -

[jira] [Created] (TEZ-2798) NPE when executing TestMemoryWithEvents::testMemoryScatterGather

Rajesh Balamohan created TEZ-2798: - Summary: NPE when executing TestMemoryWithEvents::testMemoryScatterGather Key: TEZ-2798 URL: https://issues.apache.org/jira/browse/TEZ-2798 Project: Apache Tez

[jira] [Commented] (TEZ-2789) Backport events added in TEZ-2612 to branch-0.7

[ https://issues.apache.org/jira/browse/TEZ-2789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14736633#comment-14736633 ] Rajesh Balamohan commented on TEZ-2789: --- lgtm overall. +1. > Backport events added in

[jira] [Commented] (TEZ-2643) Minimize number of empty spills in Pipelined Sorter

[ https://issues.apache.org/jira/browse/TEZ-2643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14736527#comment-14736527 ] Rajesh Balamohan commented on TEZ-2643: --- Thanks [~saikatr]. lgtm. +1. Will commit shor

[jira] [Created] (TEZ-2791) Reduce tez.runtime.shuffle.fetch.buffer.percent default value to avoid corner case OOMs

Rajesh Balamohan created TEZ-2791: - Summary: Reduce tez.runtime.shuffle.fetch.buffer.percent default value to avoid corner case OOMs Key: TEZ-2791 URL: https://issues.apache.org/jira/browse/TEZ-2791 P

[jira] [Updated] (TEZ-2783) Refactor analyzers to extend TezAnalyzerBase

[ https://issues.apache.org/jira/browse/TEZ-2783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-2783: -- Attachment: TEZ-2783.3.patch Fixing findbug warning (related to string concat) > Refactor analyze

[jira] [Updated] (TEZ-2784) optimize TaskImpl.isFinished()

[ https://issues.apache.org/jira/browse/TEZ-2784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-2784: -- Summary: optimize TaskImpl.isFinished() (was: micro optimization: optimize TaskImpl.isFinished())

[jira] [Updated] (TEZ-2783) Refactor analyzers to extend TezAnalyzerBase

[ https://issues.apache.org/jira/browse/TEZ-2783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-2783: -- Target Version/s: 0.8.1 > Refactor analyzers to extend TezAnalyzerBase > -

[jira] [Updated] (TEZ-2783) Refactor analyzers to extend TezAnalyzerBase

[ https://issues.apache.org/jira/browse/TEZ-2783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-2783: -- Attachment: TEZ-2783.2.rebased.patch Attaching rebased patch. > Refactor analyzers to extend TezA

[jira] [Commented] (TEZ-2788) Allow TezAnalyzerBase to parse SimpleHistory logs

[ https://issues.apache.org/jira/browse/TEZ-2788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14735968#comment-14735968 ] Rajesh Balamohan commented on TEZ-2788: --- >> (user running an analyzer for a dag on a g

[jira] [Commented] (TEZ-2788) Allow TezAnalyzerBase to parse SimpleHistory logs

[ https://issues.apache.org/jira/browse/TEZ-2788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14735928#comment-14735928 ] Rajesh Balamohan commented on TEZ-2788: --- >> added support to download the ATS data to

[jira] [Commented] (TEZ-2788) Allow TezAnalyzerBase to parse SimpleHistory logs

[ https://issues.apache.org/jira/browse/TEZ-2788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14735762#comment-14735762 ] Rajesh Balamohan commented on TEZ-2788: --- lgtm. +1 > Allow TezAnalyzerBase to parse Si

[jira] [Updated] (TEZ-2784) micro optimization: optimize TaskImpl.isFinished()

[ https://issues.apache.org/jira/browse/TEZ-2784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-2784: -- Attachment: TEZ-2784.1.patch > micro optimization: optimize TaskImpl.isFinished() > --

[jira] [Updated] (TEZ-2784) micro optimization: optimize TaskImpl.isFinished()

[ https://issues.apache.org/jira/browse/TEZ-2784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-2784: -- Attachment: (was: TEZ-2784.1.patch) > micro optimization: optimize TaskImpl.isFinished() > ---

[jira] [Updated] (TEZ-2784) micro optimization: optimize TaskImpl.isFinished()

[ https://issues.apache.org/jira/browse/TEZ-2784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-2784: -- Attachment: TEZ-2784.1.patch AM_Profiler_snapshot.jpg > micro optimization: optimi

[jira] [Created] (TEZ-2784) micro optimization: optimize TaskImpl.isFinished()

Rajesh Balamohan created TEZ-2784: - Summary: micro optimization: optimize TaskImpl.isFinished() Key: TEZ-2784 URL: https://issues.apache.org/jira/browse/TEZ-2784 Project: Apache Tez Issue Typ

[jira] [Commented] (TEZ-2643) Minimize number of empty spills in Pipelined Sorter

[ https://issues.apache.org/jira/browse/TEZ-2643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14734071#comment-14734071 ] Rajesh Balamohan commented on TEZ-2643: --- Sorry about the delay [~saikatr]. Patch opt

[jira] [Updated] (TEZ-2783) Refactor analyzers to extend TezAnalyzerBase

[ https://issues.apache.org/jira/browse/TEZ-2783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-2783: -- Attachment: TEZ-2783.1.patch > Refactor analyzers to extend TezAnalyzerBase >

[jira] [Created] (TEZ-2783) Refactor analyzers to extend TezAnalyzerBase

Rajesh Balamohan created TEZ-2783: - Summary: Refactor analyzers to extend TezAnalyzerBase Key: TEZ-2783 URL: https://issues.apache.org/jira/browse/TEZ-2783 Project: Apache Tez Issue Type: Bug

[jira] [Updated] (TEZ-2782) VertexInfo.getAvgExecutionTimeInterval throws NPE when task does not have any valid attempts info

[ https://issues.apache.org/jira/browse/TEZ-2782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-2782: -- Attachment: TEZ-2782.1.patch > VertexInfo.getAvgExecutionTimeInterval throws NPE when task does no

[jira] [Updated] (TEZ-2778) Improvements to handle read errors - part 2

[ https://issues.apache.org/jira/browse/TEZ-2778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-2778: -- Attachment: dag_1439860407967_0579_1.svg DAG.png lgtm. +1. Very minor comment - Sh

[jira] [Created] (TEZ-2782) VertexInfo.getAvgExecutionTimeInterval throws NPE when task does not have any valid attempts info

Rajesh Balamohan created TEZ-2782: - Summary: VertexInfo.getAvgExecutionTimeInterval throws NPE when task does not have any valid attempts info Key: TEZ-2782 URL: https://issues.apache.org/jira/browse/TEZ-2782

[jira] [Comment Edited] (TEZ-2774) Reduce logging in the AM

[ https://issues.apache.org/jira/browse/TEZ-2774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14730057#comment-14730057 ] Rajesh Balamohan edited comment on TEZ-2774 at 9/3/15 11:48 PM: --

[jira] [Commented] (TEZ-2774) Reduce logging in the AM

[ https://issues.apache.org/jira/browse/TEZ-2774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14730057#comment-14730057 ] Rajesh Balamohan commented on TEZ-2774: --- YarnTaskSchedulerService - Changes related to

[jira] [Commented] (TEZ-2731) Fix Tez GenericCounter performance bottleneck

[ https://issues.apache.org/jira/browse/TEZ-2731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14728385#comment-14728385 ] Rajesh Balamohan commented on TEZ-2731: --- Committed to branch-0.7 >>> commit: 5dc0770fe

[jira] [Updated] (TEZ-2731) Fix Tez GenericCounter performance bottleneck

[ https://issues.apache.org/jira/browse/TEZ-2731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-2731: -- Fix Version/s: 0.7.1 > Fix Tez GenericCounter performance bottleneck > ---

[jira] [Updated] (TEZ-2731) Fix Tez GenericCounter performance bottleneck

[ https://issues.apache.org/jira/browse/TEZ-2731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-2731: -- Target Version/s: 0.7.1 (was: 0.8.0-alpha) > Fix Tez GenericCounter performance bottleneck >

[jira] [Commented] (TEZ-2767) Make TezMxBeanResourceCalculator the default resource calculator

[ https://issues.apache.org/jira/browse/TEZ-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14728234#comment-14728234 ] Rajesh Balamohan commented on TEZ-2767: --- Sorry, missed it in the earlier reivew. lgtm.

[jira] [Commented] (TEZ-2575) Handle KeyValue pairs size which do not fit in a single block in PipelinedSorter

[ https://issues.apache.org/jira/browse/TEZ-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14727413#comment-14727413 ] Rajesh Balamohan commented on TEZ-2575: --- committed to branch-0.7 commit 0e155e718

[jira] [Updated] (TEZ-2602) Throwing EOFException when launching MR job

[ https://issues.apache.org/jira/browse/TEZ-2602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-2602: -- Fix Version/s: 0.7.1 > Throwing EOFException when launching MR job > -

[jira] [Updated] (TEZ-2575) Handle KeyValue pairs size which do not fit in a single block in PipelinedSorter

[ https://issues.apache.org/jira/browse/TEZ-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-2575: -- Fix Version/s: 0.7.1 > Handle KeyValue pairs size which do not fit in a single block in > Pipelin

[jira] [Commented] (TEZ-2602) Throwing EOFException when launching MR job

[ https://issues.apache.org/jira/browse/TEZ-2602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14727410#comment-14727410 ] Rajesh Balamohan commented on TEZ-2602: --- committed to branch-0.7 >>> commit 52f8cd9408

[jira] [Updated] (TEZ-2602) Throwing EOFException when launching MR job

[ https://issues.apache.org/jira/browse/TEZ-2602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-2602: -- Target Version/s: 0.7.1 (was: 0.8.0-alpha) > Throwing EOFException when launching MR job > --

[jira] [Comment Edited] (TEZ-2575) Handle KeyValue pairs size which do not fit in a single block in PipelinedSorter

[ https://issues.apache.org/jira/browse/TEZ-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14727338#comment-14727338 ] Rajesh Balamohan edited comment on TEZ-2575 at 9/2/15 1:34 PM: ---

[jira] [Updated] (TEZ-2575) Handle KeyValue pairs size which do not fit in a single block in PipelinedSorter

[ https://issues.apache.org/jira/browse/TEZ-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-2575: -- Attachment: TEZ-2575.branch-0.7.patch Rebasing for branch-0.7. TEZ-2602 also needs to be ported a

[jira] [Updated] (TEZ-2198) Fix sorter spill counts

[ https://issues.apache.org/jira/browse/TEZ-2198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-2198: -- Target Version/s: 0.7.1 (was: 0.7.0) Fix Version/s: 0.7.1 > Fix sorter spill counts >

[jira] [Commented] (TEZ-2198) Fix sorter spill counts

[ https://issues.apache.org/jira/browse/TEZ-2198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14726889#comment-14726889 ] Rajesh Balamohan commented on TEZ-2198: --- Committed to branch-0.7 >>> commit aa767b90ee

[jira] [Updated] (TEZ-2198) Fix sorter spill counts

[ https://issues.apache.org/jira/browse/TEZ-2198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-2198: -- Attachment: TEZ-2198.branch-0.7.patch Attaching rebased patch for branch 0.7. > Fix sorter spill

[jira] [Commented] (TEZ-2440) Sorter should check for indexCacheList.size() in flush()

[ https://issues.apache.org/jira/browse/TEZ-2440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14726624#comment-14726624 ] Rajesh Balamohan commented on TEZ-2440: --- Committed to branch-0.7.1 >> commit dfb703d4a

[jira] [Updated] (TEZ-2440) Sorter should check for indexCacheList.size() in flush()

[ https://issues.apache.org/jira/browse/TEZ-2440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-2440: -- Target Version/s: 0.7.1 (was: 0.8.0-alpha) Fix Version/s: 0.7.1 > Sorter should check for

[jira] [Updated] (TEZ-2440) Sorter should check for indexCacheList.size() in flush()

[ https://issues.apache.org/jira/browse/TEZ-2440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-2440: -- Attachment: TEZ-2440.brnach-0.7.patch Uploading patch for branch-0.7 > Sorter should check for in

[jira] [Commented] (TEZ-2767) Make TezMxBeanResourceCalculator the default resource calculator

[ https://issues.apache.org/jira/browse/TEZ-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14726453#comment-14726453 ] Rajesh Balamohan commented on TEZ-2767: --- It was added as a separate sub-module, so tha

[jira] [Commented] (TEZ-2767) Make TezMxBeanResourceCalculator the default resource calculator

[ https://issues.apache.org/jira/browse/TEZ-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14726415#comment-14726415 ] Rajesh Balamohan commented on TEZ-2767: --- When I applied the patch, I had to manually m

[jira] [Commented] (TEZ-2584) Investigate: Reducers with local errors can run indefinitely

[ https://issues.apache.org/jira/browse/TEZ-2584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14724987#comment-14724987 ] Rajesh Balamohan commented on TEZ-2584: --- Patch in TEZ-2750 should address this as well

[jira] [Commented] (TEZ-2750) Cascading tests hang with 0.8-alpha

[ https://issues.apache.org/jira/browse/TEZ-2750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14724986#comment-14724986 ] Rajesh Balamohan commented on TEZ-2750: --- lgtm. +1. TEZ-2584 is similar to this. Will

[jira] [Resolved] (TEZ-2759) Containers not getting released if app is killed in the middle of execution

[ https://issues.apache.org/jira/browse/TEZ-2759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan resolved TEZ-2759. --- Resolution: Not A Problem number of containers retained was within the min-held setting. Closing

[jira] [Created] (TEZ-2759) Containers not getting released if app is killed in the middle of execution

Rajesh Balamohan created TEZ-2759: - Summary: Containers not getting released if app is killed in the middle of execution Key: TEZ-2759 URL: https://issues.apache.org/jira/browse/TEZ-2759 Project: Apac

[jira] [Commented] (TEZ-2290) Scale memory for Default Sorter down to a max of 2047 MB if configured higher

[ https://issues.apache.org/jira/browse/TEZ-2290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14724549#comment-14724549 ] Rajesh Balamohan commented on TEZ-2290: --- Thanks [~hitesh]. Committed addendum patch to

[jira] [Updated] (TEZ-2290) Scale memory for Default Sorter down to a max of 2047 MB if configured higher

[ https://issues.apache.org/jira/browse/TEZ-2290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-2290: -- Attachment: TEZ-2290.branch-0.6-and-0.5.addendum.patch [~hitesh] - Adding addendum patch for branc

[jira] [Commented] (TEZ-2739) Improve handling of read errors in critical path analyzer

[ https://issues.apache.org/jira/browse/TEZ-2739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14723409#comment-14723409 ] Rajesh Balamohan commented on TEZ-2739: --- lgtm. +1. >>> createStep("v[23] : 00_0",

[jira] [Resolved] (TEZ-2565) Consider scanning unfinished tasks in VertexImpl::constructStatistics to reduce merge overhead

[ https://issues.apache.org/jira/browse/TEZ-2565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan resolved TEZ-2565. --- Resolution: Fixed Updated CHANGES.txt to have the info available in "ALL CHANGES" section as we

[jira] [Commented] (TEZ-2565) Consider scanning unfinished tasks in VertexImpl::constructStatistics to reduce merge overhead

[ https://issues.apache.org/jira/browse/TEZ-2565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14715644#comment-14715644 ] Rajesh Balamohan commented on TEZ-2565: --- [~sseth] - Patch is not reverted. I need to u

[jira] [Updated] (TEZ-2738) ContainerLauncher tries to connect to unhealthy node for large number of times

[ https://issues.apache.org/jira/browse/TEZ-2738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-2738: -- Attachment: log.txt.gz Thanks [~zjffdu]. Looks like the entire logs didn't get uploaded. Attachin

[jira] [Updated] (TEZ-2738) ContainerLauncher tries to connect to unhealthy node for large number of times

[ https://issues.apache.org/jira/browse/TEZ-2738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-2738: -- Attachment: logs.tar.gz Attaching logs > ContainerLauncher tries to connect to unhealthy node for

[jira] [Updated] (TEZ-2738) ContainerLauncher tries to connect to unhealthy node for large number of times

[ https://issues.apache.org/jira/browse/TEZ-2738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-2738: -- Description: Env: Ran a job with tez (built from master branch on aug-24). One of the nodes went

[jira] [Created] (TEZ-2738) ContainerLauncher tries to connect to unhealthy node for large number of times

Rajesh Balamohan created TEZ-2738: - Summary: ContainerLauncher tries to connect to unhealthy node for large number of times Key: TEZ-2738 URL: https://issues.apache.org/jira/browse/TEZ-2738 Project: A

[jira] [Commented] (TEZ-2290) Scale memory for Default Sorter down to a max of 2047 MB if configured higher

[ https://issues.apache.org/jira/browse/TEZ-2290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707745#comment-14707745 ] Rajesh Balamohan commented on TEZ-2290: --- Committed to branch 0.6 and 0.5 >>> branch 0

[jira] [Commented] (TEZ-2732) DefaultSorter throws ArrayIndex exceptions on 2047 Mb size sort buffers

[ https://issues.apache.org/jira/browse/TEZ-2732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707744#comment-14707744 ] Rajesh Balamohan commented on TEZ-2732: --- committed to branch-0.6 and 0.5 >> branch 0.

[jira] [Updated] (TEZ-2732) DefaultSorter throws ArrayIndex exceptions on 2047 Mb size sort buffers

[ https://issues.apache.org/jira/browse/TEZ-2732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-2732: -- Attachment: TEZ-2732.branch-0.6-and-0.5.patch Attaching patch for branch 0.6 and 0.5. TestDefaultS

[jira] [Updated] (TEZ-2290) Scale memory for Default Sorter down to a max of 2047 MB if configured higher

[ https://issues.apache.org/jira/browse/TEZ-2290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-2290: -- Fix Version/s: 0.6.3 0.5.5 > Scale memory for Default Sorter down to a max of 2

[jira] [Updated] (TEZ-2290) Scale memory for Default Sorter down to a max of 2047 MB if configured higher

[ https://issues.apache.org/jira/browse/TEZ-2290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-2290: -- Attachment: TEZ-2290.branch-0.6-and-0.5.patch Rebasing the patch for branch-0.6 and 0.5 > Scale m

[jira] [Commented] (TEZ-2734) Add a test to verify the filename generated by OnDiskMerge

[ https://issues.apache.org/jira/browse/TEZ-2734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707644#comment-14707644 ] Rajesh Balamohan commented on TEZ-2734: --- lgtm. +1 >> InputAttemptIdentifier iIdentifi

[jira] [Updated] (TEZ-2732) DefaultSorter throws ArrayIndex exceptions on 2047 Mb size sort buffers

[ https://issues.apache.org/jira/browse/TEZ-2732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-2732: -- Attachment: TEZ-2732.branch-0.7.patch Rebasing same patch for branch-0.7 > DefaultSorter throws A

[jira] [Commented] (TEZ-2690) Add critical path analyser

[ https://issues.apache.org/jira/browse/TEZ-2690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14706701#comment-14706701 ] Rajesh Balamohan commented on TEZ-2690: --- lgtm. +1. Very minor comments {noformat}

[jira] [Commented] (TEZ-2628) History logging plugin to write ATS events to HDFS

[ https://issues.apache.org/jira/browse/TEZ-2628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14706543#comment-14706543 ] Rajesh Balamohan commented on TEZ-2628: --- Tested this on small scale cluster. It works

[jira] [Commented] (TEZ-2732) DefaultSorter throws ArrayIndex exceptions on 2047 Mb size sort buffers

[ https://issues.apache.org/jira/browse/TEZ-2732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14706254#comment-14706254 ] Rajesh Balamohan commented on TEZ-2732: --- Attaching the patch for review. [~hitesh], [

[jira] [Updated] (TEZ-2732) DefaultSorter throws ArrayIndex exceptions on 2047 Mb size sort buffers

[ https://issues.apache.org/jira/browse/TEZ-2732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-2732: -- Attachment: TEZ-2732.1.patch > DefaultSorter throws ArrayIndex exceptions on 2047 Mb size sort buf

[jira] [Commented] (TEZ-2732) DefaultSorter throws ArrayIndex exceptions on 2047 Mb size sort buffers

[ https://issues.apache.org/jira/browse/TEZ-2732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14706253#comment-14706253 ] Rajesh Balamohan commented on TEZ-2732: --- One more place where similar overflow can hap

[jira] [Comment Edited] (TEZ-2731) Fix Tez GenericCounter performance bottleneck

[ https://issues.apache.org/jira/browse/TEZ-2731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14706236#comment-14706236 ] Rajesh Balamohan edited comment on TEZ-2731 at 8/21/15 5:04 AM: --

[jira] [Commented] (TEZ-2731) Fix Tez GenericCounter performance bottleneck

[ https://issues.apache.org/jira/browse/TEZ-2731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14706236#comment-14706236 ] Rajesh Balamohan commented on TEZ-2731: --- java version: "1.7.0_67" java -XX:+Aggressiv

[jira] [Commented] (TEZ-2731) Fix Tez GenericCounter performance bottleneck

[ https://issues.apache.org/jira/browse/TEZ-2731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14706228#comment-14706228 ] Rajesh Balamohan commented on TEZ-2731: --- lgtm. +1. Had it been uncontended synchroniza

[jira] [Created] (TEZ-2732) DefaultSorter throws ArrayIndex exceptions on 2047 Mb size sort buffers

Rajesh Balamohan created TEZ-2732: - Summary: DefaultSorter throws ArrayIndex exceptions on 2047 Mb size sort buffers Key: TEZ-2732 URL: https://issues.apache.org/jira/browse/TEZ-2732 Project: Apache T

[jira] [Comment Edited] (TEZ-2690) Add critical path analyser

[ https://issues.apache.org/jira/browse/TEZ-2690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14702605#comment-14702605 ] Rajesh Balamohan edited comment on TEZ-2690 at 8/19/15 10:04 AM: -

[jira] [Comment Edited] (TEZ-2690) Add critical path analyser

[ https://issues.apache.org/jira/browse/TEZ-2690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14702605#comment-14702605 ] Rajesh Balamohan edited comment on TEZ-2690 at 8/19/15 6:56 AM: --

[jira] [Updated] (TEZ-2690) Add critical path analyser

[ https://issues.apache.org/jira/browse/TEZ-2690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-2690: -- Attachment: dag_1439860407967_0030_1.svg > Add critical path analyser > --

[jira] [Commented] (TEZ-2690) Add critical path analyser

[ https://issues.apache.org/jira/browse/TEZ-2690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14702605#comment-14702605 ] Rajesh Balamohan commented on TEZ-2690: --- More comments on analyzer - SVG prints the ve

[jira] [Commented] (TEZ-2690) Add critical path analyser

[ https://issues.apache.org/jira/browse/TEZ-2690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14702537#comment-14702537 ] Rajesh Balamohan commented on TEZ-2690: --- lgtm overall. Minor comments. - TezAnalyzerB

[jira] [Commented] (TEZ-2164) Shade the guava version used by Tez

[ https://issues.apache.org/jira/browse/TEZ-2164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14702181#comment-14702181 ] Rajesh Balamohan commented on TEZ-2164: --- - Built (guava-tez-18.jar got added to $TEZ_H

[jira] [Updated] (TEZ-2729) Standalone sample UI for running tez job analyzers

[ https://issues.apache.org/jira/browse/TEZ-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-2729: -- Attachment: TEZ-2729.WIP.PoC.1.patch Attaching the very preliminary poc patch which uses Vaadin we

[jira] [Created] (TEZ-2729) Standalone sample UI for running tez job analyzers

Rajesh Balamohan created TEZ-2729: - Summary: Standalone sample UI for running tez job analyzers Key: TEZ-2729 URL: https://issues.apache.org/jira/browse/TEZ-2729 Project: Apache Tez Issue Typ

[jira] [Commented] (TEZ-2726) Handle invalid number of partitions for SCATTER-GATHER edge

[ https://issues.apache.org/jira/browse/TEZ-2726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700369#comment-14700369 ] Rajesh Balamohan commented on TEZ-2726: --- [~saikatr] - Is there any repro for this? Whe

[jira] [Commented] (TEZ-2003) [Umbrella] Allow Tez to co-ordinate execution to external services

[ https://issues.apache.org/jira/browse/TEZ-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14696802#comment-14696802 ] Rajesh Balamohan commented on TEZ-2003: --- TaskSchedulerEventHandler - What is the purp

[jira] [Updated] (TEZ-2719) Consider reducing logs in unordered fetcher with shared-fetch option

[ https://issues.apache.org/jira/browse/TEZ-2719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-2719: -- Attachment: TEZ-2719.branch-0.7.patch TEZ-2719.2.patch Attaching patch for master

<    4   5   6   7   8   9   10   11   12   13   >