[jira] [Created] (TEZ-4194) NPE in FetcherOrderedGrouped

2020-06-23 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created TEZ-4194: - Summary: NPE in FetcherOrderedGrouped Key: TEZ-4194 URL: https://issues.apache.org/jira/browse/TEZ-4194 Project: Apache Tez Issue Type: Bug Affects Ve

[jira] [Commented] (TEZ-4170) RootInputInitializerManager could make use of ThreadPool from appContext

2020-05-27 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17118331#comment-17118331 ] Rajesh Balamohan commented on TEZ-4170: --- Thanks for sharing the patch. 1. handleInit

[jira] [Commented] (TEZ-4186) Limits: Fix init order regression from TEZ-4155

2020-05-20 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17112754#comment-17112754 ] Rajesh Balamohan commented on TEZ-4186: --- +1. Thanks for the patch [~gopalv] .  > Lim

[jira] [Commented] (TEZ-4179) [Kubernetes] Extend NodeId in tez to support unique worker identity

2020-05-18 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17110767#comment-17110767 ] Rajesh Balamohan commented on TEZ-4179: --- Minor change before commit: Mark the files a

[jira] [Commented] (TEZ-4179) [Kubernetes] Extend NodeId in tez to support unique worker identity

2020-05-18 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17110697#comment-17110697 ] Rajesh Balamohan commented on TEZ-4179: --- This would increase the mem footprint in AM

[jira] [Commented] (TEZ-4174) [Kubernetes] Fetcher should connection failure on SocketException

2020-05-13 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17106747#comment-17106747 ] Rajesh Balamohan commented on TEZ-4174: --- Committed to master. Thanks [~prasanth_j] >

[jira] [Commented] (TEZ-2672) Allow specifying a new payload for plugins when a new DAG starts

2020-05-11 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-2672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17105024#comment-17105024 ] Rajesh Balamohan commented on TEZ-2672: --- .4 patch LGTM. +1. Thanks [~abstractdog] >

[jira] [Commented] (TEZ-2672) Allow specifying a new payload for plugins when a new DAG starts

2020-05-11 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-2672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17104315#comment-17104315 ] Rajesh Balamohan commented on TEZ-2672: --- Thanks [~abstractdog]. Can {{Configuration g

[jira] [Commented] (TEZ-4174) [Kubernetes] Fetcher should connection failure on SocketException

2020-05-10 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17104045#comment-17104045 ] Rajesh Balamohan commented on TEZ-4174: --- LGTM. +1. > [Kubernetes] Fetcher should con

[jira] [Commented] (TEZ-2672) Allow specifying a new payload for plugins when a new DAG starts

2020-05-10 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-2672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17103983#comment-17103983 ] Rajesh Balamohan commented on TEZ-2672: --- Thanks for sharing the patch [~abstractdog]

[jira] [Commented] (TEZ-4171) DAGImp::getDAGStatus should try to report RUNNING state information correctly

2020-05-08 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17102598#comment-17102598 ] Rajesh Balamohan commented on TEZ-4171: --- Thanks [~gopalv] , [~jeagles] . Yes, SUBMITT

[jira] [Updated] (TEZ-4171) DAGImp::getDAGStatus should try to report RUNNING state information correctly

2020-05-07 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-4171: -- Attachment: TEZ-4171.6.patch > DAGImp::getDAGStatus should try to report RUNNING state informatio

[jira] [Updated] (TEZ-4171) DAGImp::getDAGStatus should try to report RUNNING state information correctly

2020-05-07 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-4171: -- Attachment: TEZ-4171.5.patch > DAGImp::getDAGStatus should try to report RUNNING state informatio

[jira] [Updated] (TEZ-4171) DAGImp::getDAGStatus should try to report RUNNING state information correctly

2020-05-07 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-4171: -- Attachment: TEZ-4171.4.patch > DAGImp::getDAGStatus should try to report RUNNING state informatio

[jira] [Updated] (TEZ-4171) DAGImp::getDAGStatus should try to report RUNNING state information correctly

2020-05-07 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-4171: -- Attachment: TEZ-4171.3.patch > DAGImp::getDAGStatus should try to report RUNNING state informatio

[jira] [Updated] (TEZ-4171) DAGImp::getDAGStatus should try to report RUNNING state information correctly

2020-05-07 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-4171: -- Attachment: TEZ-4171.2.patch > DAGImp::getDAGStatus should try to report RUNNING state informatio

[jira] [Updated] (TEZ-4171) DAGImp::getDAGStatus should try to report RUNNING state information correctly

2020-05-06 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-4171: -- Attachment: TEZ-4171.1.patch > DAGImp::getDAGStatus should try to report RUNNING state informatio

[jira] [Assigned] (TEZ-4171) DAGImp::getDAGStatus should try to report RUNNING state information correctly

2020-05-06 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan reassigned TEZ-4171: - Assignee: Rajesh Balamohan > DAGImp::getDAGStatus should try to report RUNNING state infor

[jira] [Created] (TEZ-4171) DAGImp::getDAGStatus should try to report RUNNING state information correctly

2020-05-06 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created TEZ-4171: - Summary: DAGImp::getDAGStatus should try to report RUNNING state information correctly Key: TEZ-4171 URL: https://issues.apache.org/jira/browse/TEZ-4171 Project: Ap

[jira] [Created] (TEZ-4170) RootInputInitializerManager could make use of ThreadPool from appContext

2020-05-05 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created TEZ-4170: - Summary: RootInputInitializerManager could make use of ThreadPool from appContext Key: TEZ-4170 URL: https://issues.apache.org/jira/browse/TEZ-4170 Project: Apache

[jira] [Commented] (TEZ-4153) IndexCache totalMemoryUsed differs from cache contents.

2020-05-04 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17098771#comment-17098771 ] Rajesh Balamohan commented on TEZ-4153: --- [~jeagles]: LGTM. +1. Minor comment: Should

[jira] [Updated] (TEZ-4156) Fix Tez to reuse IPC connections

2020-04-27 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-4156: -- Attachment: TEZ-4156.4.patch > Fix Tez to reuse IPC connections > ---

[jira] [Updated] (TEZ-4156) Fix Tez to reuse IPC connections

2020-04-27 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-4156: -- Attachment: TEZ-4156.3.patch > Fix Tez to reuse IPC connections > ---

[jira] [Commented] (TEZ-4156) Fix Tez to reuse IPC connections

2020-04-27 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17094077#comment-17094077 ] Rajesh Balamohan commented on TEZ-4156: --- [~sseth]: This is encountered frequently in

[jira] [Updated] (TEZ-4156) Fix Tez to reuse IPC connections

2020-04-27 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-4156: -- Attachment: TEZ-4156.2.patch > Fix Tez to reuse IPC connections > ---

[jira] [Commented] (TEZ-4156) Fix Tez to reuse IPC connections

2020-04-27 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17093613#comment-17093613 ] Rajesh Balamohan commented on TEZ-4156: --- [~jeagles]: Yes, the cluster where I tried o

[jira] [Commented] (TEZ-4155) Remove sync bottleneck in counters

2020-04-27 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17093163#comment-17093163 ] Rajesh Balamohan commented on TEZ-4155: --- LGTM. +1. Can you remove "violation()" metho

[jira] [Assigned] (TEZ-4156) Fix Tez to reuse IPC connections

2020-04-26 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan reassigned TEZ-4156: - Assignee: Rajesh Balamohan > Fix Tez to reuse IPC connections > --

[jira] [Updated] (TEZ-4156) Fix Tez to reuse IPC connections

2020-04-26 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-4156: -- Attachment: TEZ-4156.1.patch > Fix Tez to reuse IPC connections > ---

[jira] [Created] (TEZ-4156) Fix Tez to reuse IPC connections

2020-04-26 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created TEZ-4156: - Summary: Fix Tez to reuse IPC connections Key: TEZ-4156 URL: https://issues.apache.org/jira/browse/TEZ-4156 Project: Apache Tez Issue Type: Improvement

[jira] [Created] (TEZ-4155) Remove sync bottlneck in counters

2020-04-24 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created TEZ-4155: - Summary: Remove sync bottlneck in counters Key: TEZ-4155 URL: https://issues.apache.org/jira/browse/TEZ-4155 Project: Apache Tez Issue Type: Improvement

[jira] [Created] (TEZ-4147) Reduce NN calls in RecoveryService::handleRecoveryEvent

2020-04-15 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created TEZ-4147: - Summary: Reduce NN calls in RecoveryService::handleRecoveryEvent Key: TEZ-4147 URL: https://issues.apache.org/jira/browse/TEZ-4147 Project: Apache Tez Issu

[jira] [Commented] (TEZ-4139) Tez should consider node information for computing failure fraction

2020-04-14 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17083818#comment-17083818 ] Rajesh Balamohan commented on TEZ-4139: --- [~abstractdog]: Thanks for sharing the wip p

[jira] [Commented] (TEZ-4143) Provide an option to disable DAG graph (.dot) generation for latency sensitive jobs

2020-04-14 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17083779#comment-17083779 ] Rajesh Balamohan commented on TEZ-4143: --- +1. Thanks [~abstractdog]. > Provide an opt

[jira] [Commented] (TEZ-4146) Register RUNNING state in DAG's state change callback

2020-04-14 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17083776#comment-17083776 ] Rajesh Balamohan commented on TEZ-4146: --- Thanks [~gopalv] . Addressed the comments in

[jira] [Updated] (TEZ-4146) Register RUNNING state in DAG's state change callback

2020-04-14 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-4146: -- Attachment: TEZ-4146.3.patch > Register RUNNING state in DAG's state change callback > --

[jira] [Updated] (TEZ-4146) Register RUNNING state in DAG's state change callback

2020-04-13 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-4146: -- Attachment: TEZ-4146.2.patch > Register RUNNING state in DAG's state change callback > --

[jira] [Assigned] (TEZ-4146) Register RUNNING state in DAG's state change callback

2020-04-13 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan reassigned TEZ-4146: - Assignee: Rajesh Balamohan > Register RUNNING state in DAG's state change callback > -

[jira] [Updated] (TEZ-4146) Register RUNNING state in DAG's state change callback

2020-04-13 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-4146: -- Attachment: TEZ-4146.1.patch > Register RUNNING state in DAG's state change callback > --

[jira] [Created] (TEZ-4146) Register RUNNING state in DAG's state change callback

2020-04-13 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created TEZ-4146: - Summary: Register RUNNING state in DAG's state change callback Key: TEZ-4146 URL: https://issues.apache.org/jira/browse/TEZ-4146 Project: Apache Tez Issue

[jira] [Commented] (TEZ-4143) Provide an option to disable DAG graph (.dot) generation for latency sensitive jobs

2020-04-13 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17082760#comment-17082760 ] Rajesh Balamohan commented on TEZ-4143: --- Thanks for sharing the patch [~abstractdog]

[jira] [Commented] (TEZ-4145) Reduce lock contention in TezSpillRecord

2020-04-13 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17082758#comment-17082758 ] Rajesh Balamohan commented on TEZ-4145: --- Yes, {{TezSpillRecord::writeToFile}} would h

[jira] [Commented] (TEZ-4145) Reduce lock contention in TezSpillRecord

2020-04-13 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17082242#comment-17082242 ] Rajesh Balamohan commented on TEZ-4145: --- Note: TezSpillRecord is in the hot path in f

[jira] [Created] (TEZ-4145) Reduce lock contention in TezSpillRecord

2020-04-13 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created TEZ-4145: - Summary: Reduce lock contention in TezSpillRecord Key: TEZ-4145 URL: https://issues.apache.org/jira/browse/TEZ-4145 Project: Apache Tez Issue Type: Improve

[jira] [Created] (TEZ-4143) Provide an option to disable DAG graph (.dot) generation for latency sensitive jobs

2020-04-13 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created TEZ-4143: - Summary: Provide an option to disable DAG graph (.dot) generation for latency sensitive jobs Key: TEZ-4143 URL: https://issues.apache.org/jira/browse/TEZ-4143 Proje

[jira] [Commented] (TEZ-4139) Tez should consider node information for computing failure fraction

2020-04-06 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17076762#comment-17076762 ] Rajesh Balamohan commented on TEZ-4139: --- For ref: Observed this when analyzing Q28

[jira] [Created] (TEZ-4139) Tez should consider node information for computing failure fraction

2020-04-06 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created TEZ-4139: - Summary: Tez should consider node information for computing failure fraction Key: TEZ-4139 URL: https://issues.apache.org/jira/browse/TEZ-4139 Project: Apache Tez

[jira] [Created] (TEZ-4138) Provide an option to retain tez recovery file in job logs

2020-04-02 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created TEZ-4138: - Summary: Provide an option to retain tez recovery file in job logs Key: TEZ-4138 URL: https://issues.apache.org/jira/browse/TEZ-4138 Project: Apache Tez Is

[jira] [Commented] (TEZ-4135) Improve memory allocation when executing in-memory reads

2020-03-23 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17064632#comment-17064632 ] Rajesh Balamohan commented on TEZ-4135: --- Yes, something like "((Configurable) codec).

[jira] [Commented] (TEZ-4135) Improve memory allocation when executing in-memory reads

2020-03-19 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17063053#comment-17063053 ] Rajesh Balamohan commented on TEZ-4135: --- Sure, TEZ-3645 should be helpful as well in.

[jira] [Assigned] (TEZ-4087) Shuffle: Fix shuffle cleanup to prevent thread leaks

2020-03-19 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan reassigned TEZ-4087: - Assignee: Rajesh Balamohan > Shuffle: Fix shuffle cleanup to prevent thread leaks > --

[jira] [Updated] (TEZ-4087) Shuffle: Fix shuffle cleanup to prevent thread leaks

2020-03-19 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-4087: -- Attachment: TEZ-4087.1.patch > Shuffle: Fix shuffle cleanup to prevent thread leaks > ---

[jira] [Created] (TEZ-4135) Improve memory allocation when executing in-memory reads

2020-03-16 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created TEZ-4135: - Summary: Improve memory allocation when executing in-memory reads Key: TEZ-4135 URL: https://issues.apache.org/jira/browse/TEZ-4135 Project: Apache Tez Iss

[jira] [Commented] (TEZ-4135) Improve memory allocation when executing in-memory reads

2020-03-16 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17060232#comment-17060232 ] Rajesh Balamohan commented on TEZ-4135: --- Example scenario can be Q78 in Hive. > Impr

[jira] [Commented] (TEZ-4128) Logging: Fix ArrayOutOfBound in PipelineSorter

2020-03-01 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17048695#comment-17048695 ] Rajesh Balamohan commented on TEZ-4128: --- Can you share the sort mb for this job? This

[jira] [Updated] (TEZ-4115) turn on data-via-events as default

2020-01-20 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-4115: -- Priority: Minor (was: Major) > turn on data-via-events as default >

[jira] [Commented] (TEZ-4115) turn on data-via-events as default

2020-01-16 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17017583#comment-17017583 ] Rajesh Balamohan commented on TEZ-4115: --- +1 pending tests. > turn on data-via-events

[jira] [Updated] (TEZ-4113) TezUtils::createByteStringFromConf should use snappy instead of DeflaterOutputStream

2020-01-09 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-4113: -- Attachment: TEZ-4113.1.patch > TezUtils::createByteStringFromConf should use snappy instead of >

[jira] [Assigned] (TEZ-4113) TezUtils::createByteStringFromConf should use snappy instead of DeflaterOutputStream

2020-01-09 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan reassigned TEZ-4113: - Assignee: Rajesh Balamohan > TezUtils::createByteStringFromConf should use snappy instead

[jira] [Created] (TEZ-4113) TezUtils::createByteStringFromConf should use snappy instead of DeflaterOutputStream

2020-01-09 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created TEZ-4113: - Summary: TezUtils::createByteStringFromConf should use snappy instead of DeflaterOutputStream Key: TEZ-4113 URL: https://issues.apache.org/jira/browse/TEZ-4113 Proj

[jira] [Comment Edited] (TEZ-4098) tez-tools improvements: log-split, swimlane

2020-01-05 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17008563#comment-17008563 ] Rajesh Balamohan edited comment on TEZ-4098 at 1/6/20 6:13 AM: --

[jira] [Comment Edited] (TEZ-4098) tez-tools improvements: log-split, swimlane

2019-12-17 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16998070#comment-16998070 ] Rajesh Balamohan edited comment on TEZ-4098 at 12/17/19 10:38 AM: ---

[jira] [Commented] (TEZ-4098) tez-tools improvements: log-split, swimlane

2019-12-17 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16998070#comment-16998070 ] Rajesh Balamohan commented on TEZ-4098: --- Thanks [~abstractdog]. Very minor comment. I

[jira] [Commented] (TEZ-4108) NullPointerException during speculative execution race condition

2019-12-16 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16997718#comment-16997718 ] Rajesh Balamohan commented on TEZ-4108: --- LGTM. +1 "secondAttempt" in the testcase (T

[jira] [Commented] (TEZ-1869) Exclude tez-ui war / other dependencies from tez.tar.gz

2019-12-15 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-1869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16996894#comment-16996894 ] Rajesh Balamohan commented on TEZ-1869: --- Thanks [~jeagles]. Uploading .3 version reba

[jira] [Updated] (TEZ-1869) Exclude tez-ui war / other dependencies from tez.tar.gz

2019-12-15 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-1869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-1869: -- Attachment: TEZ-1869.3.patch > Exclude tez-ui war / other dependencies from tez.tar.gz >

[jira] [Commented] (TEZ-1869) Exclude tez-ui war / other dependencies from tez.tar.gz

2019-12-13 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-1869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16995453#comment-16995453 ] Rajesh Balamohan commented on TEZ-1869: --- Rebasing for master. > Exclude tez-ui war /

[jira] [Updated] (TEZ-1869) Exclude tez-ui war / other dependencies from tez.tar.gz

2019-12-13 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-1869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-1869: -- Attachment: TEZ-1869.2.patch > Exclude tez-ui war / other dependencies from tez.tar.gz >

[jira] [Commented] (TEZ-4098) tez-tools improvements: log-split, swimlane

2019-12-08 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16991009#comment-16991009 ] Rajesh Balamohan commented on TEZ-4098: --- Thanks for sharing the patch. It would be he

[jira] [Created] (TEZ-4099) Add details on whether SSL is enabled or not in HttpConnectionParams

2019-11-12 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created TEZ-4099: - Summary: Add details on whether SSL is enabled or not in HttpConnectionParams Key: TEZ-4099 URL: https://issues.apache.org/jira/browse/TEZ-4099 Project: Apache Tez

[jira] [Assigned] (TEZ-4096) SSLFactory should pickup configs from incoming conf payload

2019-11-08 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan reassigned TEZ-4096: - Assignee: Rajesh Balamohan > SSLFactory should pickup configs from incoming conf payload >

[jira] [Commented] (TEZ-4096) SSLFactory should pickup configs from incoming conf payload

2019-11-08 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16970657#comment-16970657 ] Rajesh Balamohan commented on TEZ-4096: --- Thanks [~gopalv] . Will commit to master sho

[jira] [Updated] (TEZ-4096) SSLFactory should pickup configs from incoming conf payload

2019-11-08 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-4096: -- Summary: SSLFactory should pickup configs from incoming conf payload (was: SSLFactory should mak

[jira] [Commented] (TEZ-4096) SSLFactory should make an attempt to add ssl config resources as "Path"

2019-11-06 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16968330#comment-16968330 ] Rajesh Balamohan commented on TEZ-4096: --- Yes [~jeagles] . Attaching a revised patch.

[jira] [Updated] (TEZ-4096) SSLFactory should make an attempt to add ssl config resources as "Path"

2019-11-06 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-4096: -- Attachment: TEZ-4096.3.patch > SSLFactory should make an attempt to add ssl config resources as "

[jira] [Updated] (TEZ-4096) SSLFactory should make an attempt to add ssl config resources as "Path"

2019-11-05 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-4096: -- Description: SSLFactory uses "String" instead of "Path" for adding "ssl-client.xml". When addRes

[jira] [Commented] (TEZ-4096) SSLFactory should make an attempt to add ssl config resources as "Path"

2019-11-05 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16967442#comment-16967442 ] Rajesh Balamohan commented on TEZ-4096: --- Attaching .2 version, where it tries to load

[jira] [Updated] (TEZ-4096) SSLFactory should make an attempt to add ssl config resources as "Path"

2019-11-05 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-4096: -- Summary: SSLFactory should make an attempt to add ssl config resources as "Path" (was: SSLFactor

[jira] [Updated] (TEZ-4096) SSLFactory should make use of "Path" instead of "String" when adding ssl resource config

2019-11-05 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-4096: -- Attachment: TEZ-4096.2.patch > SSLFactory should make use of "Path" instead of "String" when addi

[jira] [Commented] (TEZ-4096) SSLFactory should make use of "Path" instead of "String" when adding ssl resource config

2019-11-05 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16967435#comment-16967435 ] Rajesh Balamohan commented on TEZ-4096: --- [~sseth] , [~gopalv]  : Can you plz review?

[jira] [Updated] (TEZ-4096) SSLFactory should make use of "Path" instead of "String" when adding ssl resource config

2019-11-05 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-4096: -- Attachment: TEZ-4096.1.patch > SSLFactory should make use of "Path" instead of "String" when addi

[jira] [Created] (TEZ-4096) SSLFactory should make use of "Path" instead of "String" when adding ssl resource config

2019-11-05 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created TEZ-4096: - Summary: SSLFactory should make use of "Path" instead of "String" when adding ssl resource config Key: TEZ-4096 URL: https://issues.apache.org/jira/browse/TEZ-4096

[jira] [Commented] (TEZ-4091) UnorderedPartitionedKVWriter::readDataForDME should check if in-mem file is flushed or not

2019-10-17 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954166#comment-16954166 ] Rajesh Balamohan commented on TEZ-4091: --- Thanks for the review [~sseth] . Merged the

[jira] [Assigned] (TEZ-4091) UnorderedPartitionedKVWriter::readDataForDME should check if in-mem file is flushed or not

2019-10-17 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan reassigned TEZ-4091: - Assignee: Rajesh Balamohan > UnorderedPartitionedKVWriter::readDataForDME should check if

[jira] [Updated] (TEZ-4091) UnorderedPartitionedKVWriter::readDataForDME should check if in-mem file is flushed or not

2019-10-16 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-4091: -- Attachment: TEZ-4091.2.patch > UnorderedPartitionedKVWriter::readDataForDME should check if in-me

[jira] [Commented] (TEZ-4091) UnorderedPartitionedKVWriter::readDataForDME should check if in-mem file is flushed or not

2019-10-16 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16953397#comment-16953397 ] Rajesh Balamohan commented on TEZ-4091: --- precommit env is still broken as it ends up

[jira] [Updated] (TEZ-4091) UnorderedPartitionedKVWriter::readDataForDME should check if in-mem file is flushed or not

2019-10-16 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-4091: -- Attachment: TEZ-4091.1.patch > UnorderedPartitionedKVWriter::readDataForDME should check if in-me

[jira] [Created] (TEZ-4091) UnorderedPartitionedKVWriter::readDataForDME should check if in-mem file is flushed or not

2019-10-13 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created TEZ-4091: - Summary: UnorderedPartitionedKVWriter::readDataForDME should check if in-mem file is flushed or not Key: TEZ-4091 URL: https://issues.apache.org/jira/browse/TEZ-4091

[jira] [Commented] (TEZ-4088) Create in-memory ifile writer for transferring smaller payloads (follow up of TEZ-4075)

2019-10-10 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949124#comment-16949124 ] Rajesh Balamohan commented on TEZ-4088: --- Thanks for the review [~sseth]. Merged PR wi

[jira] [Commented] (TEZ-4088) Create in-memory ifile writer for transferring smaller payloads (follow up of TEZ-4075)

2019-10-10 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949085#comment-16949085 ] Rajesh Balamohan commented on TEZ-4088: --- precommit builds seem broken. It is not doin

[jira] [Updated] (TEZ-4088) Create in-memory ifile writer for transferring smaller payloads (follow up of TEZ-4075)

2019-10-10 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-4088: -- Attachment: TEZ-4088.6.patch > Create in-memory ifile writer for transferring smaller payloads (f

[jira] [Updated] (TEZ-4088) Create in-memory ifile writer for transferring smaller payloads (follow up of TEZ-4075)

2019-10-10 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-4088: -- Attachment: TEZ-4088.5.patch > Create in-memory ifile writer for transferring smaller payloads (f

[jira] [Commented] (TEZ-4087) Shuffle: Fix shuffle cleanup to prevent thread leaks

2019-10-10 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16948475#comment-16948475 ] Rajesh Balamohan commented on TEZ-4087: --- I will try to get more logs and share the de

[jira] [Comment Edited] (TEZ-4087) Shuffle: Check for thread's liveliness regularly to avoid infinite wait in merger & referee threads

2019-10-09 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16948176#comment-16948176 ] Rajesh Balamohan edited comment on TEZ-4087 at 10/10/19 3:44 AM:

[jira] [Updated] (TEZ-4087) Shuffle: Fix shuffle cleanup to prevent thread leaks

2019-10-09 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-4087: -- Summary: Shuffle: Fix shuffle cleanup to prevent thread leaks (was: Shuffle: Check for thread's

[jira] [Commented] (TEZ-4087) Shuffle: Check for thread's liveliness regularly to avoid infinite wait in merger & referee threads

2019-10-09 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16948176#comment-16948176 ] Rajesh Balamohan commented on TEZ-4087: --- Got more details on the logs. Pasting a snip

[jira] [Commented] (TEZ-4090) TezIDCache::getInstance sync lock

2019-10-08 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16947240#comment-16947240 ] Rajesh Balamohan commented on TEZ-4090: --- Looks like non-sync WeakHashMap has chances

[jira] [Created] (TEZ-4090) TezIDCache::getInstance sync lock

2019-10-08 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created TEZ-4090: - Summary: TezIDCache::getInstance sync lock Key: TEZ-4090 URL: https://issues.apache.org/jira/browse/TEZ-4090 Project: Apache Tez Issue Type: Bug

[jira] [Updated] (TEZ-4088) Create in-memory ifile writer for transferring smaller payloads (follow up of TEZ-4075)

2019-10-07 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-4088: -- Attachment: TEZ-4088.3.patch > Create in-memory ifile writer for transferring smaller payloads (f

[jira] [Updated] (TEZ-4088) Create in-memory ifile writer for transferring smaller payloads (follow up of TEZ-4075)

2019-10-07 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/TEZ-4088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated TEZ-4088: -- Attachment: TEZ-4088.2.patch > Create in-memory ifile writer for transferring smaller payloads (f

<    1   2   3   4   5   6   7   8   9   10   >